Skip to content

Conversation

@yiyixuxu
Copy link
Collaborator

enable the DeprecatedAttentionBlockTests again

follow up on #7620
we disabled the test because of this issue, which is now fixed by this PR and that's already in the latest release

@yiyixuxu
Copy link
Collaborator Author

cc @sayakpaul

can you look into this why the tests still fail? it should work now with device_map="balanced"

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Comment on lines 511 to 513
if class_name.startswith("Flax"):
raise ValueError("Flax pipelines are not supported with `device_map`.")

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why delete it?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just so that we can run the fast test with the tiny checkpoints
why wouldn't it work with flax pipelines?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

accalerate is a Pytorch only library and we rely on accelerate for device map.

@sayakpaul sayakpaul mentioned this pull request Apr 18, 2024
@sayakpaul
Copy link
Member

@yiyixuxu fixed it here: #7705.

Additionally, I think we should pin to accelerate>=0.29.3.

@yiyixuxu yiyixuxu force-pushed the fix-device-map-test branch from 3b24568 to d4be522 Compare April 19, 2024 02:59
@yiyixuxu
Copy link
Collaborator Author

@sayakpaul
can you take a look again?

@sayakpaul
Copy link
Member

Do you want me to review the PR? The tests are passing.

_deps = [
"Pillow", # keep the PIL.Image.Resampling deprecation away
"accelerate>=0.11.0",
"accelerate>=0.29.3",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Works for me!

Copy link
Member

@sayakpaul sayakpaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's go

@yiyixuxu yiyixuxu merged commit e567401 into main Apr 19, 2024
@yiyixuxu yiyixuxu deleted the fix-device-map-test branch April 19, 2024 05:21
sayakpaul added a commit that referenced this pull request Dec 23, 2024
* style


* Fix device map nits (#7705)


---------

Co-authored-by: Sayak Paul <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants