ProCem

The ProCem (Social Energy - Prosumer Centric Energy Ecosystem) and ProCemPlus (Prosumer Centric Energy Communities - towards Energy Ecosystem) projects have collected energy and energy community related data from the Kampusareena building in the Hervanta campus, the Marjamäki micro-grid area in Lempäälä and open data sources.

The data for all of the datasets provided by ProCem have been collected using a custom data collection platform developed as part of the projects. Thus all the data is stored in the same way and in the same format and accessing all the data happens in the same way. If you are interested in learning more about the data collection platform, it has been described in a scientific article titled "A Data Collection and Supplementary Control Platform of a Modern Building for Smart Energy Applications".

The data is stored in simple CSV files on a network drive to which select project researchers have access to. All data from a measurement target (Kampusareena or Marjamäki) for a day are stored in one file. One line of this CSV file contains these 3 items separated by a tab character:

  • id: Each measurement point has a unique id number. These are documented in the lists of the available measurements for each dataset.
  • value: The actual measurement value.
  • timestamp: Unix time in milliseconds i.e. milliseconds since 1970-01-01 00:00 UTC time.

If you want to see a small example of how these files look like, you can check this sample data.

If you are interested in getting some data from the ProCem datasets, you can contact the person marked as the dataset maintainer. Since the raw data files are very large and contain data sensitive to the data owner, you will be provided with filtered versions of the data files containing only the data you require from the time period you want. So, if you already know precisely what data you want and from what time period, you can provide the measurement ids of the measurements you want with the range of dates.

Note, though generally the data collection has been continuous since the date marked as the measurement start date, various issues with measurement devices, networking or the collection system have caused breaks in data collection varying from minutes to days. So please take this into account when processing your data.