Published on Mon Sep 28 2020

Visual Exploration and Knowledge Discovery from Biomedical Dark Data

Shashwat Aggarwal, Ramesh Singh

Data visualization techniques proffer efficient means to organize and present data in graphically appealing formats. Data visualization techniques provide a promising solution to explore such data by allowing quick comprehension of information.

0
0
0
Abstract

Data visualization techniques proffer efficient means to organize and present data in graphically appealing formats, which not only speeds up the process of decision making and pattern recognition but also enables decision-makers to fully understand data insights and make informed decisions. Over time, with the rise in technological and computational resources, there has been an exponential increase in the world's scientific knowledge. However, most of it lacks structure and cannot be easily categorized and imported into regular databases. This type of data is often termed as Dark Data. Data visualization techniques provide a promising solution to explore such data by allowing quick comprehension of information, the discovery of emerging trends, identification of relationships and patterns, etc. In this empirical research study, we use the rich corpus of PubMed comprising of more than 30 million citations from biomedical literature to visually explore and understand the underlying key-insights using various information visualization techniques. We employ a natural language processing based pipeline to discover knowledge out of the biomedical dark data. The pipeline comprises of different lexical analysis techniques like Topic Modeling to extract inherent topics and major focus areas, Network Graphs to study the relationships between various entities like scientific documents and journals, researchers, and, keywords and terms, etc. With this analytical research, we aim to proffer a potential solution to overcome the problem of analyzing overwhelming amounts of information and diminish the limitation of human cognition and perception in handling and examining such large volumes of data.

Fri Jul 03 2020
NLP
Exploration and Discovery of the COVID-19 Literature through Semantic Visualization
Semantic visualization is a method of enabling exploration and discovering over large datasets of complex networks by exploiting the semantics of the relations in them. This involves (i) NLP to extract named entities, relations and knowledge graphs from the original data.
0
0
0
Tue Aug 18 2020
NLP
COVID-SEE: Scientific Evidence Explorer for COVID-19 Related Research
Covid-SEE is a system for medical literature discovery based on the concept of information exploration. It builds on several distinct text-analysis and natural language processing methods to structure and organise information in publications.
0
0
0
Fri Sep 19 2014
NLP
Interactive Visual Exploration of Topic Models using Graphs
Probabilistic topic modeling is a popular and powerful family of tools for uncovering thematic structure in large sets of unstructured text documents. By connecting topic nodes via descriptive keyterms, the graph reveals topic similarities, topic meaning and shared, ambiguous keyterms.
0
0
0
Sun May 31 2020
NLP
NLP Scholar: An Interactive Visual Explorer for Natural Language Processing Literature
0
0
0
Fri Aug 02 2019
Artificial Intelligence
OntoPlot: A Novel Visualisation for Non-hierarchical Associations in Large Ontologies
OntoPlot is a novel visualisation specifically designed to facilitate the exploration of all concepts. It combines icicle plots, visual compression techniques and interactivity, improving space-efficiency.
0
0
0
Tue Jun 23 2015
Artificial Intelligence
Scientific Discovery by Machine Intelligence: A New Avenue for Drug Research
The majority of big data is unstructured and of this majority the largest chunk is text. Data mining techniques are well developed and standardized for structured, numerical data. The Holy Grail, however, is knowledge discovering, where machines are expected to unearth entirely new facts and relations.
0
0
0