Skip to content

Conversation

@i-am-sijia
Copy link
Contributor

@i-am-sijia i-am-sijia commented Oct 20, 2025

This PR addresses #1002.

  • When the specified explicit_chunk is larger than the number of choosers, the model runs in one chunk, equivalent to chunkless. [1]
  • When running multiprocess, the model divides explicit_chunk by num_processes, so users don't need to change explicit_chunk when they change num_processes. In this case, the value of explicit_chunk represents the total number of choosers running concurrently across all processes, within a machine's memory limit. [2][3]

@i-am-sijia i-am-sijia marked this pull request as ready for review October 20, 2025 21:27
@i-am-sijia i-am-sijia requested review from bwentl and jpn-- October 21, 2025 18:45
@bwentl
Copy link
Contributor

bwentl commented Oct 22, 2025

@i-am-sijia , I did a full sample run with 1.3 million households and 3.28 million population with sharrow and multiprocessing on, and my run completed successfully using whole number explicit_chunk fix you implemented.

Thanks!

Copy link
Member

@jpn-- jpn-- left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TGTM

@jpn-- jpn-- merged commit 34539d0 into ActivitySim:main Oct 23, 2025
19 checks passed
@i-am-sijia i-am-sijia deleted the explicit-chunk-quick-fix branch October 23, 2025 17:17
m-richards pushed a commit to m-richards/activitysim that referenced this pull request Dec 15, 2025
* fix for num_choosers < chunk_size

* update assert logic
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants