IDS Conventions
Location Changed
The content of this page has been moved to TetraScience Confluence and it's not public-facing anymore. We will revise this page once self-service IDS is available.
Before you read this page, you need to have the basic knowledge of IDS. Please start with Understanding IDS Design if you are new to it and then come back.
Introduction
Because TetraScience uses Elasticsearch and AWS Athena for data indexing, every IDS must follow certain rules when creating these files for your data to be correctly indexed. In general, IDS design can be broken down into two parts:
- Platform Requirements: the rules every IDS must follow
- TS Convention: the rules mainly for design consistency across different IDS. TetraScience has abstracted data and formed opinions on the data structure. TetraScience developers are following this convention.
If you want to create your own IDS, you need 3 files in your IDS folder:
- schema.json
- elasticsearch.json
- athena.json
Each file has a design doc associated with it. You need to start with schema.json
. Then move on to elasticsearch.json
and athena.json
.
Design Doc Links
- IDS Design - schema.json
- IDS Design - elasticsearch.json
- IDS Design - athena.json
- IDS Design - schema templates
IDS Validator
TetraScience has an IDS validator that will validate whether your IDS complies with the platform requirements when you deploy it. The validator can be found here: https://github.com/tetrascience/ts-ids-validator.
Updated 3 months ago