...

Blue is the course and instructor evaluation system used at Tufts. Each year, the evaluation data needs to be collected, processed and transmitted to two systems: Symplectic Elements (SoE instructor and course data) and Faculty Success (A&S instructor and course data). Additionally, all the ASE data and Fletcher data is typically consumed in a tableau Tableau dashboard.

To facilitate this process, a workflow has been created that incorporates the following:

...

• Lambda

  • blue-data

• Batch

  • blue-batch

• Box

  • https://tufts.box.com/s/0mu3synulw1mnuq6f938fpg73uy0ljpl

• Denodo VDP

  • education_technology

    • 01-base_layer

      • 01-connections

        • coursescore

        • instructorscore

        • get_blue_api_key

        • getallprojectmetadata

        • ds_box_blue_report_by_school

        • ds_box_blue_report_by_subject

      • 02-base_views

        • bv_coursescore

        • bv_get_blue_api_key

        • bv_getallprojectmetadata

        • bv_instructorscore

      02-transformation

      • blue

        • p_coursescore

        • p_instructorscore

        • p_blue_secondary_subject

        • p_blue_subject

        • p_blue_subject_fact

        • p_blue_questionbv_blue_subject_fact

        • bv_blue_question

        • bv_blue_question_fact

        • bv_blue_data

        • bv_box_blue_report_by_school

        • bv_box_blue_report_by_subject

    • 02-transformation

      • blue

        • p_coursescore

        • p_instructorscore

        • p_blue_secondary_subject

        • p_blue_question_factsubject

        • p_course_evaluation

        • p_course_evaluation_fltr

    • 03-integration

      • j_coursescore_apikey_projectmetadata

      • j_coursescore_vw

      • j_getallprojectmetadata_api_key

      • j_instructorscore_apikey_projectmetadata

      • j_instructorscore_vw

      • j_blue_loaded_projects

      • j_blue_project_load_list

      • j_blue_secondary_subject_detail

      • j_blue_subject_detail

      • j_course_evaluation_all

    • 04-interface_fulfillment

      • coursescore_vw

      • instructorscore_vw

      • course_evaluation_fltr

      • course_evaluation

      • course_eval_sec_model

      • d_blue_fltr_deptid

• Denodo Scheduler

  • blue_data_cache

  • blue-subject-details-cache

Loading of Blue Data into Aurora DW

The AWS batch job blue-batch linked above is responsible for loading Blue data into the Aurora DW which course_evaluation views in Denodo rely on. The jobs runs weekly daily for each environment. The job loads projects based on the output of j_project_load_list in Denodo. The job also relies on bv_get_blue_api_key which returns the API key from Secrets Manager via Denodo.

...

A consolidated access control file (linked above) has been created in Box to handle access control in both Blue and Tableau. The sheets ReportBy-School and ReportBy-Subject list UTLNs by school or subject values. A column in each sheet called auth_managers has all UTLNs comma separated. For Blue, these sheets are exported and loaded in manually. For Denodo, connections and views for each sheet allow the data to be loaded in directly and joined to the bv_blue_subject_fact view within j_course_evaluation_all. This creates a unioned auth_managers column combining school and subject access which can be used in Tableau.

...