...
The integration runs daily via a job in the Denodo Scheduler that sends data incrementally by checking for rows that are new or changed compared to the data cached the previous day. The feed relies on the fetching of a session ID from Enterprise Health via Lambda to make more rapid, successive API calls.
Design
Components
Bold items are final/consumed views
Denodo VDP
human_resources
01-base_layer
01-connections
ds_eh_hr_feed_data_queue
ds_eh_hr_feed_session_id
02-base_views
bv_eh_hr_feed_data_queue
bv_eh_hr_feed_session_id
02-transformations
persons_health
persons_health_current_cache
persons_health_previous_cache
03-integration
j_persons_health_country
persons_eh_hr_feed_data_queue_history
persons_health_current_previous_diff
persons_eh_hr_feed_data_queue_incremental
persons_eh_hr_feed_data_queue_manual
Denodo Scheduler
eh_hr_feed_data_queue
eh_hr_feed_data_queue_failure_check
Lambda
...