...

The integration runs daily via a job in the Denodo Scheduler that sends data incrementally by checking for rows that are new or changed compared to the data cached the previous day. The feed relies on the fetching of a session ID from Enterprise Health via Lambda to make more rapid, successive API calls.

Design

...

Components

Bold items are final/consumed views

• Denodo VDP

  • human_resources

    • 01-base_layer

      • 01-connections

        • ds_eh_hr_feed_data_queue

        • ds_eh_hr_feed_session_id

      • 02-base_views

        • bv_eh_hr_feed_data_queue

        • bv_eh_hr_feed_session_id

    • 02-transformations

      • persons_health

      • persons_health_current_cache

      • persons_health_previous_cache

    • 03-integration

      • j_persons_health_country

      • persons_eh_hr_feed_data_queue_history

      • persons_health_current_previous_diff

      • persons_eh_hr_feed_data_queue_incremental

      • persons_eh_hr_feed_data_queue_manual

• Denodo Scheduler

  • eh_session_id

  • eh_current_cache

  • eh_hr_data_feed_data_queue_queue_previous_cache

  • eh_incremental_load

  • eh_hr_feed_data_queue_failure_check

• Lambda

  • enterprise-health

• Enterprise Health

  • Dev (DM): https://tuftsdm.enterprise.health/webchart.cgi

  • Prod: https://tuftsu.enterprise.health/webchart.cgi

How-To

Force a full data load

Invalidate the cache for persons_health_previous_cache via the Design Studio UI or using this query (with the human_resources VDB selected)

ALTER VIEW persons_health_previous_cache
CACHE INVALIDATE ON CASCADE;

Once the cache is invalidated, run the feed job in the scheduler.

...