Data Science Consulting for Electric Energy Consumption Analysis and Forecasting

Data Science Consulting for Electric Energy Consumption Analysis and Forecasting

MS SQL Server, Python, Cloud, Google Cloud


The Customer is an international company providing managed software solutions and consulting services for businesses operating in the energy sector.


The Customer initiated the development of a cloud-based data analytics software product for electric power companies, which could facilitate electric energy consumption analysis, deliver accurate electric energy consumption forecasts (hourly, daily, and weekly), and become the basis for load forecasting and price determination.

Their project became stalled as the Customer needed a third-party review for the already developed part of software to define its strengths and weaknesses and get detailed recommendations on enhancing its analytical capabilities and designing the required machine learning (ML) models.


ScienceSoft’s team of data scientists and data engineers started with the analysis of the Customer’s business objectives and requirements for the future software product. After that, they reviewed the existing software architecture and suggested the enhanced architecture (Figure 1) in accordance with the Customer’s strategic and tactical goals.

Enhanced software architecture

Figure 1. Enhanced software architecture.

ScienceSoft’s experts continued with the review of ML code and suggested creating ML models according to the following process: 

  • Data acquisition. 
  • Exploratory data analysis to investigate data for patterns and anomalies, test hypothesis and check assumptions.
  • Configuration of parameters and hyperparameters for training models.
  • Data preprocessing (dealing with missing values, categorical values, etc.).
  • Model exploration.
  • Model training.
  • Model evaluation and tuning.
  • Model retraining based on new data.

To ensure the high accuracy of ML models, the consulting team recommended that the Customer: 

  • Use the full potential of exploratory data analysis (EDA) to examine the interrelationships between features, discover interesting subsets, and determine correlations between predictor and the target variables.
  • Employ pure time series models, including LSTM-based neural networks like Seq2Seq models.
  • Use classical ML models like LightGBM or XGBoost for time series forecasting and revealing the time-dependent data nature.
  • Incorporate additional data (public holidays, local events, day length, geographical position, etc.) to move model forecasts to the next level of precision. 
  • Employ online machine learning to train models on newly coming data.


The Customer obtained high-level software architecture and detailed recommendations on how to create ML models for accurate forecasting. Delivered software would enable electric power companies to get accurate short-term and mid-term forecasting about electric energy consumption, improve load management and price determination processes.

Technologies and Tools

Google Cloud Platform, Microsoft SQL Server, Pandas, Python, Scikit-learn, TensorFlow, NumPy, Jupyter.

Need help with a similar project?

Drop us a line, and our rep will contact you within 30 minutes to arrange an initial discussion.

More Case Studies

Big Data Implementation for Advertising Channel Analysis in 10+ Countries</a> </p> <p class="cs-description">Migration to a new analytical system that ScienceSoft implemented helped one of the top market research companies secure an innovative big data solution based on Apache Hadoop, Apache Hive and Apache Spark frameworks. The new system was 100 times faster compared to the old one and could process 1,000 different data formats.</p> <a href="" class="btn btn-link-arrow btn-link-arrow--right cs-learn-more-btn"> LEARN MORE </a> </div> </div> <div class="cs-item-wrapper"> <div class="cs-image-container"> <a href="" class="cs-image-wrapper"> <img class="lazy cs-image" width="200" height="200" src="data:image/svg+xml;base64,CiAgICAgICAgICAgIDxzdmcgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJyB2aWV3Qm94PScwIDAgMjAwIDIwMCc+CiAgICAgICAgICAgICAgICA8cmVjdCB3aWR0aD0nMjAwJyBoZWlnaHQ9JzIwMCcgZmlsbD0nI2YyZjJmMicvPgogICAgICAgICAgICA8L3N2Zz4KICAgICAgICA=" data-src="/boss/images/02d65838-eb3a-4d54-b7aa-b6b7aa0c1d47bi_healthcare.png" alt="BI Implementation for 200 Healthcare Centers"> </a> </div> <div class="cs-content"> <p class="cs-title accented-text"> <a href="">BI Implementation for 200 Healthcare Centers</a> </p> <p class="cs-description">ScienceSoft created software to help 200 US healthcare centers and retirement homes to process patient and medication data. Solution consists of Java application for management and reporting along with an analytical data warehouse to consolidate information from 200 databases.</p> <a href="" class="btn btn-link-arrow btn-link-arrow--right cs-learn-more-btn"> LEARN MORE </a> </div> </div> ">