top of page
  • Writer's pictureJiehwan Yang

[Internship] BI Engineering: ELK stack for a Full-text Search and Self-Reporting Service

Updated: Jan 18, 2022

I had an opportunity to do a summer internship at a 3PL (3rd Party Logistics) company before my junior year. Another summer intern and I joined the Business Intelligence (BI) team, and we were assigned an 11-week long project to build a web application providing the following functions:


1. Fast and accurate search engine for SSRS reports and Tableau dashboards on the same UI


Unless the clients knew the exact directory of the report and dashboard, they were wasting time finding reports. Moreover, they had to open two different websites to retrieve SSRS report and Tableau dashboard. A fast search and display of SSRS report and Tableau dashboard on the same UI would facilitate easier tracking of reports and therefore reduce redundant emails and phone calls from clients asking BI analysts for the directory of reports.


2. Self-reporting tool for non-technical users


Clients had to specify detailed requirements and write a ticket to the BI team in order to build a new Tableau report. Enabling the clients to build their own reports (that are not too complex for BI analysts to be involved) would reduce the number of tickets to the BI team and avoid the hassle for the clients to write a ticket and wait in line.

 

Since another intern and I were in charge of the whole project, we agreed to divide the work. He was in charge of building a framework for Web Application using MVC ASP .NET, and I delved into providing the two key functions mentioned above by using ELK stack (Elasticsearch, Logstash, Kibana).


Below is the architecture of the project:


Comments


bottom of page