We are greatly excited with the new enthusiasm to introduce the Context-aware Semantic Online Analytical Processing pipeline (CaseOLAP), developed in 2016. The rapidly accumulating quantity of biomedical textual data has far exceeded the human capacity of manual curation and analysis, necessitating novel text-mining tools to extract biological insights from large volumes of scientific reports.CaseOLAP successfully quantifies user-defined phrase-category relationships through analysis of textual data.
We have developed a protocol for the complete CaseOLAP platform, including data preprocessing (i.e., downloading and parsing text documents), indexing and searching with Elasticsearch, creating a functional document structure called Text-Cube and quantifying phrase-category relationships using the core CaseOLAP algorithm.
Data preprocessing generates key-value pairs for all documents involved. As an example, a key may refer to the document PMID, while a value may refer to different document metadata. Preprocessed data is rearranged by indexing and searching for an entity count, which further facilitates the CaseOLAP score calculation. Obtained raw CaseOLAP results can be taken to integrative analysis including dimensionality reduction, clustering, temporal and geographical analysis, as well as the creation of a graphical database which enables semantic mapping of the documents .
CaseOLAP defines phrase-category relationships in an accurate (pinpoints relationships), consistent (highly reproducible), and efficient manner (processes 100,000 words/sec). Following our protocol, one can build up a cloud-computing environment supporting CaseOLAP which offers enhanced accessibility and affords grand opportunities to empower the biomedical community with phrase-mining tools for widespread research applications.
- MeSH to PMID Mapping
- Exploration of MeSH Trees
- Discovering Protein-Disease Attribution
- Discovering Drug-Disease Association
- Temporal Analysis of Scientific Innovation
- Geographical Distribution
- Phrase Based Summarization
- BigData in Biomedicine
- AI based search for Biomarker panel
- Semantic Mapping of Documents
- Co-occurance Based Network Analysis