Skip to content

Have SirCAL use the "Active" flag from the API metadata #1961

@melange396

Description

@melange396

Sir Complains-a-Lot lets us know about potential data pipeline problems by noticing when our indicator signals havent been properly updated for a while. Sometimes a signal may be discontinued for any number of reasons, and it will stop getting updated with new data. To prevent SirCAL from alerting on such signals, it consults a list of "retired" signals. Unfortunately, maintaining this list requires enumerating them all by hand (such as here and here) and the list will only grow larger over time.

Instead of relying [solely?] on the "retired" signal list, SirCAL can make use of the Active status in the metadata available through the Delphi Epidata API to determine if a signal is worth alerting on -- if a signal is not marked as being "Active", it is no longer expected to receive updates and it can thus be ignored.

A caveat to this is that SirCAL currently uses the covidcast client package to access metadata. That client uses the /covidcast_meta endpoint, but the "Active" status is only available from an alternate endpoint, /covidcast/meta.

Metadata

Metadata

Assignees

No one assigned

    Labels

    EngineeringUsed to filter issues when synching with AsanaSirCALPertains to Sir Complains-a-lot, an alerting mechanismdata qualityMissing data, weird data, broken datadevopsfuture-solutionSolutions to problems we don't have yet but still dreadgood first issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions