Skip to content

Image processing component - clicking on arbitrary coordinates of images #178

Closed
@farleylai

Description

@farleylai

Dash looks like the bridge between GUI and visualization. But how well does Dash (plan) support raw data such as images, audio and even video?

I recently build ML models to train over image dataset. To validate the trained models, I would like to have a GUI app that allows the user to inspect image patches. So the app must capture the mouse click coordinates and feed the corresponding image patch to the model. The output image data produced by the model should be rendered on the fly along with some other computed statistics (plots or numbers). I know the HTML img tag has an attribute ismap to capture this. Is that well supported in Dash or are there some component widgets already available for those use cases such as image filtering, selecting a range of audio wave or video timeline to play and so on?

Afterthought

After going through the guide and the core/html component libraries, high level components for non-text and non-graph data are not out of the box but may be imported from other existing react components (react-cursor-position, react-wavesurfer, ...). It seems like the React component sources must be ready for customization. Is it really necessary? Why not build a platform-agnostic GUI abstraction in Python and generate the React sources only for testing and deployment time? In this sense, a web SPA is simply a target platform which the developer may not even be aware of. In the future, other mobile platforms may be supported, not to mention other potential JS UI component libraries.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions