Skip to content

Incorrect size stats showed when publishing datasource #1559

@KulykDmytro

Description

@KulykDmytro

Describe the bug

Incorrect size stats showed when publishing datasource.
Fractions of MB showed however stands for fractions of TB
Looks like wrong unit conversion happened when logging (division by 1024 instead of multiplication)

Versions
Details of your environment, including:

  • Tableau Server version 2024.2.2
  • Python 3.12.6
  • TSC 0.34

To Reproduce

create datasource file with meaningful size (>128MB)

        job: JobItem = server.datasources.publish(
            datasource_item=DatasourceItem(project_id='foo', name='bar'),
            file='path/to/file.tdsx',
            mode='Overwrite',
            as_job=True,
        )

Results

[2025-01-21, 03:34:13 UTC] {tableau_hyper.py:246} INFO - Prepared hyper file size 13.2 GB
[2025-01-21, 03:34:14 UTC] {hyper.py:288} INFO - Overwrite datasource All report statistics.
[2025-01-21, 03:34:14 UTC] {datasources_endpoint.py:272} INFO - Publishing all_reports_statistics.hyper to server with chunking method (datasource over 64MB, chunk size 50MB)
[2025-01-21, 03:34:14 UTC] {fileuploads_endpoint.py:24} INFO - Initiated file upload session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:15 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:15 UTC] {fileuploads_endpoint.py:59} INFO - 	03:34:15 Published 4.9591064453125e-05MB
[2025-01-21, 03:34:16 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:16 UTC] {fileuploads_endpoint.py:59} INFO - 	03:34:16 Published 0.00010013580322265625MB
...
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:59} INFO - 	03:39:41 Published 0.012607574462890625MB
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:60} INFO - File upload finished (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions