Before you read this page, you need to have the basic knowledge of IDS. Please start with Understanding IDS Design if you are new to it and then come back.
Because TetraScience uses Elasticsearch and AWS Athena for data indexing, every IDS must follow certain rules when creating these files for your data to be correctly indexed. In general, IDS design can be broken down into two parts:
- Platform Requirements: the rules every IDS must follow
- TS Convention: the rules mainly for design consistency across different IDS. TetraScience has abstracted data and formed opinions on the data structure. TetraScience developers are following this convention.
If you want to create your own IDS, you need 3 files in your IDS folder:
Each file has a design doc associated with it. You need to start with
schema.json. Then move on to
- IDS Design - schema.json
- IDS Design - elasticsearch.json
- IDS Design - athena.json
- IDS Design - schema templates
TetraScience has an IDS validator that will validate whether your IDS complies with the platform requirements when you deploy it. The validator can be found here: https://github.com/tetrascience/ts-ids-validator.
Updated 8 days ago