Box Logs Processing Job
This job downloads logs from the Box service and makes the data available via Tableau.
...
- Owned by user apiadm
- Files located at /home/apiadm/boxLogs
- Main script is /home/apiadm/boxLogs/boxLogs.sh
- Cron job scheduled Mon-Fri at 4:00am
- Source code (with further documentation) is in GitLab at https://gitlab.it.tufts.edu/EA-APIs/box-logs-api and https://gitlab.it.tufts.edu/EA-APIs/box-logs-token-app
Known Issues
Next Stream Position is Blank
Occasionally the job will fail partway through with an error stating "Next stream position is blank". This indicates that the connection was interrupted while downloading the log files. The error seems to be more common when there is a large amount of data to be downloaded – and as a result, if the job fails due to this error, when it is run again the following day it will likely hit the error again due to the large amount of backlogged data from the previous day.
...