`TypeError: argument of type 'Part' is not iterable`

When we execute the code from the test playground for Gemini in Vertex AI Studio, there is a type error. Actually, _raw_part is not a dict. It is of type Part, as an extension of proto.Message. So, the text property of the class Part is not available as keyword...

I have found no way to extract text from a streaming response other than using repr function and trimming it.

Environment details

• OS type and version: MacOS Sonoma 14.2
• Python version: 3.11.5
• pip version: 23.2.1
• google-cloud-aiplatform version:

Name: google-cloud-aiplatform
Version: 1.38.1
Summary: Vertex AI API client library
Home-page: https://github.com/googleapis/python-aiplatform
Author: Google LLC
Author-email: googleapis-packages@google.com
License: Apache 2.0
Location: /Users/xxxxxxx/anaconda3/lib/python3.11/site-packages
Requires: google-api-core, google-cloud-bigquery, google-cloud-resource-manager, google-cloud-storage, packaging, proto-plus, protobuf, shapely
Required-by: 

Steps to reproduce

1. Just execute the example code below, after logging with gcloud

Code example

import vertexai
from vertexai.preview.generative_models import GenerativeModel  # , Part


def generate():
    """Generates text using the Generative Model."""
    # Initialize Vertex AI
    vertexai.init(project="<project_id>", location="us-central1")

    model = GenerativeModel("gemini-pro")
    responses = model.generate_content(
        """hi. I would like to know the 10 first items of the fibonacci
        sequence.""",
        generation_config={
            "max_output_tokens": 2048,
            "temperature": 0.9,
            "top_p": 1
        },
        stream=True,
    )

    for i, response in enumerate(responses):
        print("Response:", i)
        print(response.candidates[0].content.parts)
        # print(repr(response.candidates[0].content.parts[0]).split("\"")[1])
        print(response.candidates[0].content.parts[0].text)

generate()

Stack trace

Response: 0
[text: "1. 0\n2. 1\n3. 1\n4"
]
Traceback (most recent call last):
  File "/Users/xxxxxxxxx/Documents/002-git/dolibarr-invoice/services.py", line 57, in <module>
    generate()
  File "/Users/xxxxxxxxx/Documents/002-git/dolibarr-invoice/services.py", line 54, in generate
    print(response.candidates[0].content.parts[0].text)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/xxxxxxxxx/anaconda3/lib/python3.11/site-packages/vertexai/generative_models/_generative_models.py", line 1508, in text
    if "text" not in self._raw_part:
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: argument of type 'Part' is not iterable

[sasha-gitg]

@Naznouz Please use pip freeze in your environment and reply with the versions of proto-plus, google-api-core, and protobuf

pip freeze:

...
proto-plus==1.23.0
protobuf==3.20.3
...
google-api-core @ file:///Users/ec2-user/ci_py311/google-api-core_1678380873961/work
google-api-python-client==2.97.0
google-auth==2.25.2
google-auth-httplib2==0.1.0
google-cloud-aiplatform @ file:///Users/runner/miniforge3/conda-bld/google-cloud-aiplatform_1702532890117/work
google-cloud-bigquery==3.14.0
google-cloud-core @ file:///Users/ec2-user/ci_py311/google-cloud-core_1678391961515/work
google-cloud-resource-manager==1.11.0
google-cloud-storage==2.14.0
google-crc32c @ file:///Users/ec2-user/ci_py311/google-crc32c_1678380922854/work
google-resumable-media @ file:///Users/ec2-user/ci_py311/google-resumable-media_1678391983737/work
googleapis-common-protos @ file:///Users/ec2-user/ci_py311/googleapis-common-protos-feedstock_1678326429456/work
...

[sasha-gitg]

I wasn't able to recreate the issue with:

proto-plus==1.23.0
protobuf==3.20.3

Can you provide the closest Pypi version for the dependencies that are installed from local paths?

[Ark-kun]

@Naznouz This error is a bit puzzling. Could you please check the type of the raw part:

print(type(response.candidates[0].content.parts[0]._raw_part))

Here is the result
Used code:

import vertexai
from vertexai.preview.generative_models import GenerativeModel  # , Part


def generate():
    """Generates text using the Generative Model."""
    # Initialize Vertex AI
    vertexai.init(project="upgradecode", location="us-central1")

    model = GenerativeModel("gemini-pro")
    responses = model.generate_content(
        """hi. I would like to know the 10 first items of the fibonacci
        sequence.""",
        generation_config={
            "max_output_tokens": 2048,
            "temperature": 0.9,
            "top_p": 1
        },
        stream=True,
    )

    for i, response in enumerate(responses):
        print("Response `content.parts`:", i)
        print(response.candidates[0].content.parts)
        # print(repr(response.candidates[0].content.parts[0]).split("\"")[1])
        print("Response `content._raw_part`:")
        print(response.candidates[0].content.parts[0]._raw_part)
        print("Response `content.text`:")
        print(response.candidates[0].content.parts[0].text)


generate()

Result:

Response `content.parts`: 0
[text: "1. 0\n2. 1\n3. 1 \n"
]
Response `content._raw_part`:
text: "1. 0\n2. 1\n3. 1 \n"

Response `content.text`:
Traceback (most recent call last):
  File "/Users/nizarayed/Documents/002-git/dolibarr-invoice/gcloud_ai.py", line 32, in <module>
    generate()
  File "/Users/nizarayed/Documents/002-git/dolibarr-invoice/gcloud_ai.py", line 29, in generate
    print(response.candidates[0].content.parts[0].text)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/nizarayed/anaconda3/lib/python3.11/site-packages/vertexai/generative_models/_generative_models.py", line 1508, in text
    if "text" not in self._raw_part:
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: argument of type 'Part' is not iterable

May be some additional information that would help: I'm using a conda environment and here is the list of proto related librairies:

$ pip freeze | grep proto 
googleapis-common-protos @ file:///Users/ec2-user/ci_py311/googleapis-common-protos-feedstock_1678326429456/work
proto-plus==1.23.0
protobuf==3.20.3

$ conda list proto
# packages in environment at /xxx/xxx/anaconda3:
#
# Name                    Version                   Build  Channel
googleapis-common-protos  1.60.0                   pypi_0    pypi
googleapis-common-protos-grpc 1.56.4          py311hecd8cb5_0  
libprotobuf               3.20.3               hfff2838_0  
proto-plus                1.23.0                   pypi_0    pypi
protobuf                  4.24.1                   pypi_0    pypi

I have made another test using a virtual env and it was fine.
So may be, the issue is related to conda package google-cloud-aiplatform (macos):

$ conda list google
# packages in environment at /xxx/xxx/anaconda3:
#
# Name                    Version                   Build  Channel
google-api-core           2.11.1                   pypi_0    pypi
google-api-core-grpc      2.10.1          py311hecd8cb5_0  
google-api-python-client  2.97.0                   pypi_0    pypi
google-auth               2.25.2                   pypi_0    pypi
google-auth-httplib2      0.1.0                    pypi_0    pypi
google-cloud-aiplatform   1.38.0                   pypi_0    pypi
google-cloud-bigquery     3.14.0                   pypi_0    pypi
google-cloud-bigquery-core 3.14.1             pyhd8ed1ab_1    conda-forge
google-cloud-core         2.4.1                    pypi_0    pypi
google-cloud-resource-manager 1.11.0                   pypi_0    pypi
google-cloud-storage      2.14.0                   pypi_0    pypi
google-crc32c             1.5.0           py311h6c40b1e_0  
google-resumable-media    2.7.0                    pypi_0    pypi
googleapis-common-protos  1.60.0                   pypi_0    pypi
googleapis-common-protos-grpc 1.56.4          py311hecd8cb5_0  
grpc-google-iam-v1        0.13.0             pyhd8ed1ab_0    conda-forge

[Ark-kun]

Do you still have any environment where the issue reproduces? I'd be happy to investigate and fix it.

Part._raw_response is (should be) a proto message object. This object should support __contains__ since the proto library was created. So I'm not sure why the error can occur.

[chrissie303]

I get the same error, by just executing the python code from the playground in my google cloud shell.

[Ark-kun]

Just tried Colab:

google-cloud-aiplatform==1.39.0
googleapis-common-protos==1.62.0
proto-plus==1.23.0
protobuf==3.20.3

[Ark-kun]

@Naznouz What does print(type(response.candidates[0].content.parts[0]._raw_part)) print?

[Ark-kun]

@chrissie303 What does print(type(response.candidates[0].content.parts[0]._raw_part)) print?