Linked Open Data (LOD) has emerged as one of the largest collection of interlinked datasets on the web. Benefiting from this mine of data requires the existence of descriptive information about each dataset in the accompanying metadata. Such meta information is currently very limited to few data portals where they are usually provided manually thus giving little or bad quality insights. To address this issue, we propose a scalable automatic approach for extracting, validating and generating descriptive linked dataset profiles. This approach applies several techniques to check the validity of the attached metadata as well as providing descriptive and statistical information of a certain dataset as well as a whole data portal. Using our framework on prominent data portals shows that the general state of the Linked Open Data needs attention as most of datasets suffer from bad quality metadata and lack additional informative metrics.

Features

  • URL inspection: Check the existence of certain URL patterns
  • Meta tags inspection
  • Document Object Model (DOM) inspection
  • The identification process for each portal can be easily customized by overriding the prototype.check function for each parser
  • Metadata Extraction
  • Instance and Resource Extraction
  • Profile Validation

Project Samples

Project Activity

See All Activity >

Categories

Data Profiling

License

MIT License

Follow Roomba

Roomba Web Site

You Might Also Like
Gen AI apps are built with MongoDB Atlas Icon
Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Roomba!

Additional Project Details

Programming Language

JavaScript

Related Categories

JavaScript Data Profiling Tool

Registered

2023-06-12