...
When using Denodo in production, it’s required that service accounts be used in place of personal credentials. With personal credentials, anything that relies on those credentials will break if you leave the university. Using a service account prevents this. You can ask the Data Strategy team to have a service account created for you and assigned the appropriate privileges.
Developers
This section is dedicated to users who will be developing in Denodo and contains a collection of information to help you get started and succeed with Denodo at Tufts.
Skill requirements
SQL
Data modeling
Training
...
There is an “Introduction to Denodo' class available in the Tufts Learning Center which we require all new users to complete. Simply log in and search for “Denodo”.
...
Additionally, there is a Denodo Online User Community. If you create an account with your Tufts email, you can avoid entering the promotion code above for each course.
...
Onboarding Steps
Team new to Denodo
Data needs determined
Virtual Database (VDB) created in Denodo
AD groups created in Grouper
AD groups imported into Denodo
Team exists in Denodo
Dev AD group for team assigned
Connecting to Denodo
This section outlines Denodo’s services specific to developers and ways to connect to them
Design Studio
URL: https://denodo-solution-manager.it.tufts.edu:19443/denodo-design-studio/#/
Design Studio is a web-based IDE for developing with Denodo and will be your primary tool for Denodo development. To connect to Design Studio, follow the steps below.
Navigate to the above URL
When presented with the following screen, enter the hostname for the Development VDP (found under Virtual Data Port in the General Users section) in the following format
//denodo-dev.it.tufts.edu:9999and click Single Sign-On.
While you can use Design Studio to connect to the Stage and Production VDP’s, your access will be read-only. You can only make edits in the Development VDP.
...
Requesting access
In order to request access to data, please send a TechConnect ticket to the Data Virtualization team (data-virtualization@tufts.edu). In your ticket please include the following information:
Please provide a brief description of the business problem you are trying to solve and what you are requesting in order to address it. E.g. I am creating a dashboard for the Med School admissions team so that they can see year over year trends by degree and demographic information. I require 2 data sources to be made available in Tableau and refreshed weekly.
Data Source System
Is the source system managed internally or externally?
Please include connection information if applicable
Do you already have access to this data by other means?
Please supply a list of the data fields or tables by data source you are requesting and include what system they originate from. These do not need to be the official data field names if you do not know them- a description is fine. E.g. student name/SIS, academic program/SIS, application date/Slate.
If you are requesting any protected or sensitive data (PHI, PII, FERPA), please provide a rationale for having access to this data and the name of who has authorized the access if applicable. E.g. phone number, race, DOB, grades, admit status, vaccination status, etc.
Any additional helpful information
If you are requesting that Data Strategy create a specific view for you and/or end users, in additional to the above steps please also:
Specify what level of aggregation you need for each data source. Individual student level? Rolled up at the school or degree level?
Note any calculated fields that need to be developed and provide the business logic behind them.
Raising an Urgent Issue
If an urgent issue arises with Denodo that needs immediate attention, you should create a ticket in ServiceNow with the following field values:
Urgency: High
This will spawn the following prompt. Click Yes
Paging Location: Denodo (if known, include the specific Denodo component at issue as well)
Service: Denodo
Assignment Group: TTS Data Virtualization
This will push the ticket through the On-Call schedule set up for Denodo.
Developers
This section is dedicated to users who will be developing in Denodo and contains a collection of information to help you get started and succeed with Denodo at Tufts.
Skill requirements
SQL
Data modeling
Training
There is an “Introduction to Denodo' class available in the Tufts Learning Center which we require all new users to complete. Simply log in and search for “Denodo”.
There is also comprehensive, free on-demand training available on the Denodo website. Simply create an account using your Tufts email to access the training.
For questions, email: training@denodo.comPlease note that courses may expire if you do not complete them within a certain timeframe; however, you can simply register for the course again to extend that timeframe.Additionally, there is a Denodo Online User Community. If you create an account with your Tufts email, you can avoid entering the promotion code above for each course.
Onboarding Steps
Team new to Denodo
Data needs determined
Virtual Database (VDB) created in Denodo
AD groups created in Grouper
AD groups imported into Denodo
Team exists in Denodo
Dev AD group for team assigned
Connecting to Denodo
This section outlines Denodo’s services specific to developers and ways to connect to them
Design Studio
URL: https://denodo-solution-manager.it.tufts.edu:19443/solutiondenodo-manager-web-tool/Login
The Solution Manager is the central management tool for all Denodo environments. For developers, it’s used for deploying code through our Denodo environments.
Scheduler
URLs:
...
Design Studio is a web-based IDE for developing with Denodo and will be your primary tool for Denodo development. To connect to Design Studio, follow the steps below.
Navigate to the above URL
When presented with the following screen, enter the hostname for the Development VDP (found under Virtual Data Port in the General Users section) in the following format
//denodo-dev.it.tufts.edu:
...
9999and click Single Sign-On.
While you can use Design Studio to connect to the Stage and Production VDP’s, your access will be read-only. You can only make edits in the Development VDP.
Solution Manager
...
...
19443/solution-manager-web-tool/Login
The Solution Manager is the central management tool for all Denodo environments. For developers, it’s used for deploying code through our Denodo environments.
Scheduler
...
...
19443/webadmin/denodo-scheduler-admin/#/
The Scheduler is used for creating jobs that need to run on a regular basis against the VDP.
When prompted for Scheduler Server, using one of the VDP URLs, enter //${VDP_URL}:8000/
...
Requesting access
In order to request access to data, please send a TechConnect ticket to the Data Virtualization team (data-virtualization@tufts.edu). In your ticket please include the following information:
...
Please provide a brief description of the business problem you are trying to solve and what you are requesting in order to address it. E.g. I am creating a dashboard for the Med School admissions team so that they can see year over year trends by degree and demographic information. I require 2 data sources to be made available in Tableau and refreshed weekly.
...
Data Source System
Is the source system managed internally or externally?
Please include connection information if applicable
Do you already have access to this data by other means?
...
Please supply a list of the data fields or tables by data source you are requesting and include what system they originate from. These do not need to be the official data field names if you do not know them- a description is fine. E.g. student name/SIS, academic program/SIS, application date/Slate.
...
If you are requesting any protected or sensitive data (PHI, PII, FERPA), please provide a rationale for having access to this data and the name of who has authorized the access if applicable. E.g. phone number, race, DOB, grades, admit status, vaccination status, etc.
...
Any additional helpful information
If you are requesting that Data Strategy create a specific view for you and/or end users, in additional to the above steps please also:
...
Specify what level of aggregation you need for each data source. Individual student level? Rolled up at the school or degree level?
...
:8000/
...
Connecting Data Sources
Denodo allows you to connect to a wide variety of data sources. The sections below outline how to connect to some common types of data sources at Tufts.
...
Create a revision. All revisions should use DEV as their source environment.
Select your revision elements
If making role changes, be sure to include any objects directly associated with that role so the necessary VQL is generated to update permissions
DO NOT include any dev roles in your revisions, read roles only. This will ensure that objects are read only outside of the dev environment.
Give revision a name and description and save
Validate your revision against STAGE and PROD. This step will give you the ability to set properties for connections, allowing you to define new URL’s or and credentials for connections deployed to STAGE. This will have to be done against PROD as well, but must be done by a Denodo admin.
Deploy your revision to STAGE and PROD, confirm that it deploys successfully, and test the revision elements. If you encounter issues, delete your revision and repeat steps a through d until successful.
Announce the revision in the Revisions channel of the Denodo team in Teams asking for it to be deployed at the next Monday deployment session.
The admins will review your revision for security. If there are no issues, the revision will be deployed to STAGE and PRODvalidated against PROD and deployed. If issues are found, you will be asked to resolve them before deployment. URL’s and credentials for new datasources for PROD will need to provided to admins for entering.
Note that every connection in Denodo gets environment variables created in STAGE and PROD as part of the validation process. These variables allow you to deploy connections with different URLs in STAGE and PROD without creating separate connections and views.