Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Lambda

  • Batch

  • Box

  • Denodo VDP

    • education_technology

      • 01-base_layer

        • 01-connections

          • coursescore

          • instructorscore

          • get_blue_api_key

          • getallprojectmetadata

          • ds_box_blue_report_by_school

          • ds_box_blue_report_by_subject

        • 02-base_views

          • bv_coursescore

          • bv_get_blue_api_key

          • bv_getallprojectmetadata

          • bv_instructorscore

          • bv_blue_subject_fact

          • bv_blue_question

          • bv_blue_question_fact

          • bv_blue_data

          • bv_box_blue_report_by_school

          • bv_box_blue_report_by_subject

      • 02-transformation

        • blue

          • p_coursescore

          • p_instructorscore

          • p_blue_secondary_subject

          • p_blue_subject

          • p_course_evaluation

          • p_course_evaluation_fltr

      • 03-integration

        • j_coursescore_apikey_projectmetadata

        • j_coursescore_vw

        • j_getallprojectmetadata_api_key

        • j_instructorscore_apikey_projectmetadata

        • j_instructorscore_vw

        • j_blue_loaded_projects

        • j_blue_project_load_list

        • j_blue_secondary_subject_detail

        • j_blue_subject_detail

        • j_course_evaluation_all

      • 04-interface_fulfillment

        • coursescore_vw

        • instructorscore_vw

        • course_evaluation_fltr

        • course_evaluation

        • course_eval_sec_model

        • d_blue_fltr_deptid

  • Denodo Scheduler

    • blue_data_cache

    • blue-subject-details-cache

Loading of Blue Data into Aurora DW

The AWS batch job blue-batch linked above is responsible for loading Blue data into the Aurora DW which course_evaluation views in Denodo rely on. The jobs runs weekly daily for each environment. The job loads projects based on the output of j_project_load_list in Denodo. The job also relies on bv_get_blue_api_key which returns the API key from Secrets Manager via Denodo.

...