Pub running out of memory

[DartBot]

<img src="https://avatars.githubusercontent.com/u/8518285?v=3" align="left" width="96" height="96"hspace="10"> Issue by stevemessick
Originally opened as dart-lang/sdk#19174

---

[ed note: It looks like pub is running in the screenshot. The error message is from the vm (heap.cc). I'm not sure if the large editor memory allocation could be causing everything else to be starved, tho -- we don't know the RAM size]

'I get this `Exhausted heap space, ...' permanently.

I can hardly launch any example. Sometimes it starts before this error occurs, but most of the time it doesn't.
////////////////////////////////////////////////////////////////////////////////////
Editor: 1.5.0.edge_036922 (2014-06-03)
OS: Linux - amd64 (3.13-1-amd64)
JVM: 1.7.0_55

projects: 25

open dart files: 4

auto-run pub: true
localhost resolves to: 127.0.0.1
mem max/total/free: 3556 / 1511 / 767 MB
thread count: 43
index: 663655 relationships in 97915 keys in 655 sources

SDK installed: true
Dartium installed: true

[DartBot]

<img src="https://avatars.githubusercontent.com/u/188?v=3" align="left" width="48" height="48"hspace="10"> Comment by nex3

---

Do you get this if you run pub from the command line? Can you run with --verbose and include the results?

---

Added NeedsInfo label.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/8518285?v=3" align="left" width="48" height="48"hspace="10"> Comment by stevemessick

---

There's no further info. This was anonymous user feedback. Sorry, I forgot to switch the template.

---

Added Triaged label.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/188?v=3" align="left" width="48" height="48"hspace="10"> Comment by nex3

---

In that case, there's not really anything else we can do here.

---

Added CannotReproduce label.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/405837?v=3" align="left" width="48" height="48"hspace="10"> Comment by zoechi

---

This seems to be from me.
I tried to launch an Polmyer entry page from the examples directory in DartEditor.
Sometimes in the middle of serving the page the tools windows started showing 'Out of memory messages' (for example some images could not be loaded anymore). Sometimes the page load was already finished when the 'Out of memory messages started.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/405837?v=3" align="left" width="48" height="48"hspace="10"> Comment by zoechi

---

I still have this after the update to
Dart VM version: 1.5.0-edge.36950 (Tue Jun 3 14:58:04 2014) on "linux_x64"

[DartBot]

<img src="https://avatars.githubusercontent.com/u/2156198?v=3" align="left" width="48" height="48"hspace="10"> Comment by kasperl

---

Added this to the 1.5 milestone.
Added Triaged label.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/2156198?v=3" align="left" width="48" height="48"hspace="10"> Comment by kasperl

---

Removed Priority-Unassigned label.
Added Priority-High label.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/405837?v=3" align="left" width="48" height="48"hspace="10"> Comment by zoechi

---

It seems that my growing entry_points list is causing the issue.
I didn't think of that because there is one complex Datagrid Polymer element in lib
and all entry pages just use this component with a slightly different configuration and some small callbacks or one or two small and simple Polymer elements.

It seems pub serve tries to build every entry page when I run one of them and my suspicion is that
every entry page is built independently without reusing the already built result of the component library from an already built entry page.

I commented out all but one entry page and the start up is way faster than recently and the page is served reliably.

Maybe the already discussed lazy transformers help here too.
I didn't yet have any problems when I built all entry pages to JavaScript to publish then to GitHub pages.
 

transformers:

• polymer:
      entry_points:

  - example/e01_simple.html

  - example/e02_formatters.html

  - example/e07_events.html

  - example/e14_highlighting.html

  - example/e03_editing.html

  - example/e03a_compound_editors.html

  - example/e03b_editing_with_undo.html

  - example/composite_editor_item_details.html

  - example/totals_via_data_provider.html

  - example/e04_model.html

  - example/e05_collapsing.html

      - example/e08_alternative_display.html

  - example/autotooltips.html

[DartBot]

<img src="https://avatars.githubusercontent.com/u/46275?v=3" align="left" width="48" height="48"hspace="10"> Comment by munificent

---

Ah, thanks for the details. This sounds like the memory usage is in the polymer transformers then.

Making them lazy would likely help here, but that hasn't happened yet. I'm bouncing this to Siggy, but I would like to still be involved here and see if there's anything we can do in pub/barback to help.

---

Set owner to @sigmundch.
Removed Area-Pub label.
Added Area-Pkg, Pkg-Polymer labels.

[DartBot]

<img src="https://avatars.githubusercontent.com/u/2049220?v=3" align="left" width="48" height="48"hspace="10"> Comment by sigmundch

---

I'm marking this as blocked on getting lazy transformers in place. After that, we still need to investigate what to do after we run the transformers.

For example, we should ensure that the transformers's state & analyzer data can be collected after we run a transformer on an entrypoint.

---

Removed this from the 1.5 milestone.
Added this to the 1.6 milestone.
Removed Pkg-Polymer label.
Added Pkg-PolymerBuild label.
Marked this as being blocked by #400.