Frequently Asked Questions

TetraScience Empower Agent Installation

How to find the production version of Empower?

Open Empower Client User Interface, click the Info button. The product release version can be found in Installed Service Packs section.

950950

Which versions of Windows are supported?

The TetraScience Empower Agent should be installed on the same computer as the Empower 3 Client.

The TetraScience Empower Agent is compatible with Empower 3 Client Service Release 2 or higher. The latest version is Feature Release 5.

According to the Empower release notes (Empower 3 FR4 SR3), Empower Client can work on Windows 7 Professional or Enterprise SP1, 64-bit; Windows 10 Professional or Enterprise, 64 bit. The TetraScience Empower Agent is compatible with all these versions of Windows.

Since Microsoft has stopped supporting some of the operating systems above like Windows 7. TetraScience suggests installing the Empower Agent on the newest version of the Windows operating system to avoid possible unexpected behavior.

Is TetraScience Empower Agent a 32bit or a native 64bit application?

In the current version, TetraScience Empower Agent contains three components, two Windows Services for scanning/ extracting Injection and generating & uploading Injection files, and a Microsoft WPF-based Management Console for configuration and progress monitoring.

The Windows service, which scans and extracts the Injection from Empower through ToolKit, is built as a 32-bit application because the Empower ToolKit is 32-bit. The other two components are 64-bit applications.

Can you specify minimum/typical/ideal hardware configurations required to run the agent?

The TetraScience Empower Agent extracts the Injections from Empower and uploads them to TetraScience Data Platform.

The Agent has an option to retain the RAW files in a local drive or not.
If the RAW files are not retained, the files will be deleted once uploaded successfully. It is not required to add additional disk space.
If the RAW files are retained, the required disk space will be based on the size of the Projects and Injections.

Taking an example, for 90K injections, roughly 360 GB space is required. We recommend you allocate a separate drive for those injection files such that the Empower client application is not affected.

CPU requirements should match with the Empower client. We suggested 1X Intel E5-2620 V3 (4 cores @ 1.8 GHz). The recommended memory requirement is 16G and 8G at a minimum. Recommended network bandwidth is 1000 Mbps and 100 Mbps at a minimum.

Which version of EMPOWER is supported by the Tool?

The TetraScience Agent requires Empower 3 Client Service Release 2 or higher (SR 2 Hotfix 1, SR 2 HotFix 2, FR 3, FR 3 Hotfix 1, FR 4, SR 3). Once Empower FR5 is released, the Empower Agent will be compatible with that release as well.

Does the agent need any change to be implemented at the Empower Acquisition Server?

No. The Agent performs standard operations through Empower Toolkit. No change is required for the Empower Acquisition Server.

Must Empower Client to be installed on the same machine?

Yes, the Agent extracts Injection through Empower ToolKit, which is part of Empower Client installation. TetraScience Empower Agent will use Empower Client’s component to make the connection.

Must the agent software package be installed on each server in a CITRIX Farm if EMPOWER is running in CITRIX?

The TetraScience Agent only needs to be installed on one computer that runs the Empower Client. You can install multiple agents to spread the workload, for example, each agent targets certain projects.

Can a dedicated machine be used where no users to log in?

Yes, using a dedicated machine is highly recommended

How TetraScience Empower Agent works

How is project data extracted from Waters Empower?

Data from Empower is extracted via the TetraScience agent. The TetraScience agent is a software that is installed with the Empower client, and it is responsible for extracting project data.

How does the Agent identify which injections have to be exported?

An internal SQLite database is used to store the Injection identifier by using Empower Database Name, Project Name, Sample Set Id and Injection Id.

The default logic is that, for every scan, Agent scans all projects to detect new injections. This is due to the limitation of Empower ToolKit since there is currently no indicator on the Project level that a new injection has been created or an existing injection has been reprocessed.

However, there are two mechanisms to avoid scanning all the projects

  • The customer can configure the TetraScience Empower Agent to only re-scan the projects that are not locked. The assumption is that there will not be any changes to the locked projects.

  • Customers can enable Empower Audit Trail for their projects and TetraScience Empower Agent will detect what projects and injections have been changed since the last scan.

If the export is executed the very first time: Are there any measures in place preventing the system from being impacted by high load due to a large amount of to be exported data?

Yes, the Empower Agent will scan all of the projects with which the Empower DB Account running the Agent has the permission to access. Users can configure the Agent to only scan certain projects.
To minimize the impact on the Empower system due to the extra load, several measures can be adopted

  • Configure the TetraScience Empower Agent scanning to only take place during off-hours, for example, during the 9 pm to midnight in the Pacific time zone.

  • Configure the TetraScience Empower Agent to only scan the projects that need to be analyzed.

  • Configure the TetraScience Empower Agent to only re-scan the projects that are not locked. The assumption is that there will not be any changes to the locked projects.

  • Leverage Empower audit trail to detect what projects and injections have been changed since the last scan.

  • Create a separate drive for the Agent to store the extracted injection files or choose the option to not save injections.

Can the TetraScience Empower Agent detect injections that are updated?

Yes, the Empower Agent can detect changes of result processing date/time, and trigger re-acquisition if the injection has been updated. Following changes to injections are considered as injection updates:

  • Result/Result Set
    Created Result Set
    Created Manual Result
    Created Result
    Copied Result Set
    Copied Result
    Imported Result
    Sign Off1 Result
    Sign Off2 Result

  • Sample Set/Sample
    Run Sample Set
    Altered Sample Set
    Altered Running Sample Set
    Resumed Paused Sample Set
    Renamed Sample Set
    Copied Sample Set
    Created Process Only Sample Set
    Altered Process Only Sample Set
    Altered Sample

  • Injection
    Run Single Injection
    Imported Injection

The reprocessed files create a new version of the files in the Data Platform. The Data Platform will mark the previous version as outdated, but will still keep the previous versions in the Data Platform.

**What events trigger the Agent to regenerate/reupload the Project/User access permission data

The Tetra Empower Agent generates a JSON file containing the information of Empower User, User Types, User Group, and the list of the Projects associated with the User Group.

The Agent regenerates the JSON file when the following conditions happen:

  1. Add or delete Empower Projects
  2. Add or delete Empower Users
  3. Add or remove User Group to the Projects
  4. Delete User Group which has been assigned to a Project
  5. Add or remove users from the User Group which is assigned to a Project

The regenerated JSON file will be uploaded to Tetra Data Platform as a new version file.

How Does the Agent Generate the Injections with the Result Sign Off Options?

The Injection generation and the content included is based on the Result Sign Off option selected by the user. The option is selected based on the individual project.

OptionInjectionResultSign Off
Not RequiredAll of the Injections in the ProjectAll of the Results associated with the InjectionsAll of the Sign Offs included in the output Result
Level OneOnly the Injection containing Result with Level One Sign Off

If the injection has no Result containing Level One Sign Off. That injection should not be outputted
The Result containing Level One Sign OffAll of the Sign Offs included in the qualified output Result
Level TwoOnly the Injection containing Result with Level Two Sign Off

If the Injection has no Result having Level Two Sign Off, that injection should not be outputted.
The Result containing Level Two Sign OffAll of the Sign Offs included in the qualified output Result

Can the export be directed to already existing “in-house” data lakes?

Yes, TetraScience can leverage its APIs or a configured Data Pipeline to push data to the client’s “in-house” data lakes.

The destination can be both cloud or on-premise databases.

How long it would take for a project to be available in TetraScience Data Platform once they are in the Empower server?

It depends on two things.

  1. The size of the newly added project, namely how many injections is in the project. It typically takes less than a second to collect and then normalizes the data for one injection, thus the lag is on the order of hours for a typical project.

  2. System Capacity, high-performance CPU and enough RAM (at least 8G) help improve overall performance.

How to make TetraScience Empower Agent scale up?

The client can take advantage of a feature that TetraScience Empower Agent allows to select the Projects to be generated. So multiple TetraScience Empower Agents can be deployed. One Agent per one Empower Client.

Selecting different Projects for each Agent, this way the entire processes are running in parallel. It will largely increase the overall throughput.

What happens when the same project is renamed/moved?

If the project is renamed or moved to a different location in the same Empower instance, their injections will be treated as new injections since TetraScience uses the project name and project path to form the unique key to identify new injections.

What happens when the project is created/added?

If a new project is added or imported to the Empower instance, that project will be shown in the Projection selection tab. The System Administrator selects the project manually and saves the change to have the Agent output the RAW files.

What happens when the project is removed/deleted?

If a project is deleted or moved from the Empower instance, the extracted injection data in Data Platform still remains.

How big are the JSON files compared to the original Empower projects?

As of Q3 2018, for a project that is ~13GB large, the combined size of the JSON representation is ~24GB. TetraScience is actively working on leveraging more advanced technology to reduce the size of the extracted data.

Administration/Operation

Is the agent configurable to export only injections from pre-defined projects/user groups?

Yes. First, user accounts assigned to the agent will determine which projects the TetraScience Empower Agent can access. This can be configured at setup/installation while creating the Empower user account that the Agent can use. Second, the Agent can be configured to only scan and extract injections from selected projects. This can be configured via the Agent Management Console

Is something like a management console existing that will enable easy management of the entire solution.

Yes, management exists in two places corresponding to specific functionality. The Empower Agent has its own Management Console for configuration settings, project selection, backup/export schedule, status and setup configuration functions. The DataHub and integration can be managed from the web UI of the Tetra Data Platform.

Is the exported data a true copy?

TetraScience Empower Agent will extract data from Empower package the data on injection level and convert that into JSON per injection. This JSON file contains all the important data that customers care about, such as peak table, method, injection, result and etc. It enables visualization, search, customer application, and ELN integration.

TetraScience Empower Agent will also have the capability to export Empower projects in Empower’s native format and this is a native or “true copy” of the Empower Project file. TetraScience can provide checksum-based verification of file integrity on export/import from the Data Platform.

Is there evidence showing that the agent software is structurally validated by the vendor?

TetraScience has a quality procedure focused on Empower integration that compares data generated from the Agent with data stored in the Empower.

What will be the effort to manage the solution in terms of error handling/monitoring etc.?

TetraScience will manage, support, and upgrade the Data Platform as it is deployed in its dedicated AWS account owned by the customer. TetraScience requires the customer to provide assistance in troubleshooting issues that are related to customer business logic.

  • Tier 1, key users (TetraScience will provide runbook and documentation)
  • Tier 2, customer IT (TetraScience will provide runbook and documentation) + (TetraScience)
  • Tier 3, vendor

There are 2 places errors that may occur or monitoring will take place.

  • Empower Agent Level. To monitor Empower Agent errors, status, or other parameters, the administrator has access to:

    1. The detailed error messages are stored in the SQLite database. User can see the errors or reprocess the failed injections via the Empower Agent Management Console.

    2. The error is logged to log files, which are uploaded to the Data Platform periodically. The errors can be searched and trigger alert/notification to the TetraScience Support team at ([email protected]).

  • Data Pipeline Level.

    1.If data standardization fails, error logs will be collected via AWS CloudWatch and then trigger a notification to TetraScience Support Team at ([email protected]).

    2.Business logic on whom should receive error notification due to validation or other pipeline script failure can be configured to client specifications. For example, if the client chooses to enforce a validation step that requires the presence of a Sample or project ID, values can be configured to reach that USER with a notification. If the failure is due to file format/mismatch/data corruption or something else perhaps an Administrator would receive an alert.

Empower output files and archiving policies

Agent & ServiceOutput File TypeOutput FolderArchiving (folder)
Empower Agent
Injection Service
Raw FileSpecified by user in Management ConsoleSpecified by the System Administrator whether the Raw files should be archived.

The Agent will either keep the files in the output folder or delete the files after the files are uploaded successfully, if the System Administrator selects No Keep option from Management Control
Empower Agent
Injection Service
Agent LogLogs folder under the Agent installation folderThe Agent logs will be archived in every minute. The log files are archived to logs\archive folder. Then the Agent will upload the log files to the Data Platform periodically.

When succeeded, the logs will be moved to backup folder which is under the logs\archive\ folder.

If the log files are failed to be uploaded to the Data Platform, the files will remain in the logs\archive folder.

The Agent will keep the Agent log files up to 72 hours. After that, the Agent will delete the Agent Log files to save local disk space
Empower Agent
Archive Service
Injection Description file and
Project back up file
Specified by user in Management ConsoleWhen both files are successfully uploaded to S3 bucket, they will be removed from output folder.

If file upload is not succeeded, the Agent will retry (The retry time is user specified in Management Console) till it reaches the max retry time

If the file are still not uploaded, they will be remained in the output folder
Empower Agent
Archive Service
Audit TrailUpload to the CouldWatch group/stream, specified by the user in Management ConsoleNo files written to local folder
Empower Agent
Archive Service
Agent LogLogs folder under Agent installation folderKeep the Agent log files up to 72 hours. After that, the Agent will delete the Agent log files to save local disk space