Request: Add async support

[creatorrr]

Async support (maybe via aiorequests/aiohttp?) would be very appreciated. Esp since some of the predictions can take a while to complete.

[mohamed-ezz]

+1

[creatorrr]

Created a PR to add support for this. cc/ @bfirsh

[0dminnimda]

@creatorrr How is the progress with #76? Do you need any help/assistance?

[creatorrr]

It's ready for review, @0dminnimda

[antomin]

It's ready for review, @0dminnimda

Hi. Thanks for your job. Code in your branch is woked?

[Delamcode]

Just wondering, is there a way to make a discord bot that doesn’t get heartrate blocked without this? It’s very annoying.

[Paillat-dev]

1+

[osmanio2]

1+

[mattt]

Hi @creatorrr. Thank you for contributing #76. Thank you also for your patience, as this is a long time coming. I'm happy to report that async support landed in version 0.18.0.

Here's an example of how to run multiple predictions concurrently and wait for their results:

import asyncio
import replicate

# https://replicate.com/stability-ai/sdxl
model_version = "stability-ai/sdxl:39ed52f2a78e934b3ba6e2a89f5b1c712de7dfea535525255b1aa35c5565e08b"
prompts = [
    f"A chariot pulled by a team of {count} rainbow unicorns"
    for count in ["two", "four", "six", "eight"]
]

async with asyncio.TaskGroup() as tg:
    tasks = [
        tg.create_task(replicate.async_run(model_version, input={"prompt": prompt}))
        for prompt in prompts
    ]

results = await asyncio.gather(*tasks)
print(results)

[githubloader]

When using async_run, is it possible to run different model_versions with different prompts? Or is it only limited to one model_version to different prompts for now?