O
Orclever
Back to Journal
Research Article Open AccessOrclever Native

Data Warehouse, Detection and Transfer of Anomalies in Retail Data

Onur CIRKIN1✉
1Harran University
Published:May 31, 2023
DOI: 10.56038/ejrnd.v3i2.265
Vol. 3, No. 2

Abstract

In this article, we offer some suggestions for anomaly detection on the data received from the source to the Data warehouse. As a result, it is aimed to prevent the entry of dirty and noisy data into the data warehouse. We think that knowing that there is clean and healthy data in the data warehouse will be resistant to anomalies in the processed data used for data science. In order to reach our goal, studies were carried out on the data in the retail sector. We aimed to determine our theoretical thoughts from some topics such as user erroneous login data in the retail and energy industry, abnormal sales over employees during the campaign period, product stock abnormality, and incorrect pricing. When we examined many studies, we saw that they made anomaly detection after estimation. Before taking the data from the source to the data warehouse, we thought that anomaly detection would be more efficient and healthier. Analysis and results were evaluated on the data obtained in the wiseboard retail project of Gtech company.

Keywords
DataWarehouseAnomaly DetectionLSTMOne-class SVMIsolation Forest

References

  1. 1.Nguyen, H. D., et al. "Forecasting and Anomaly Detection approaches using LSTM and LSTM Autoencoder techniques with the applications in supply chain management." International Journal of Information Management 57 (2021): 102282.
  2. 2.Jansen, Maarten, Laurens Swinkels, and Weili Zhou. "Anomalies in the China A-share market." Pacific-Basin Finance Journal 68 (2021): 101607.
  3. 3.Hampton, Harrison, and Aoife Foley. "A review of current analytical methods, modelling tools and development frameworks applicable for future retail electricity market design." Energy (2022): 124861.
  4. 4.Oliveira, João Pedro, and Rui Dinis Sousa. "Unsupervised Anomaly Detection of Retail Stores Using Predictive Analysis Library on SAP HANA XS Advanced." Procedia Computer Science 181 (2021): 882-889.
  5. 5.Ramakrishnan, Jagdish, et al. "Anomaly detection for an e-commerce pricing system." U.S. Patent Application No. 17/721,594.
  6. 6.Chen, Xu, et al. "GraphAD: A Graph Neural Network for Entity-Wise Multivariate Time-Series Anomaly Detection." arXiv preprint arXiv:2205.11139 (2022).
  7. 7.Vincent, Vercruyssen, Meert Wannes, and Davis Jesse. "Transfer learning for anomaly detection through localized and unsupervised instance selection." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 34. No. 04. 2020.
  8. 8.Putra, Hafid Yoza. "Fraud detection at self-checkout retail using data mining." 2020 International Conference on Information Technology Systems and Innovation (ICITSI). IEEE, 2020.
  9. 9.Pourhabibi, Tahereh, et al. "Fraud detection: A systematic literature review of graph-based anomaly detection approaches." Decision Support Systems 133 (2020): 113303.
  10. 10.Leite, Roger A., et al. "Visual analytics for event detection: Focusing on fraud." Visual Informatics 2.4 (2018): 198-212.
  11. 11.Laptev, Nikolay, Saeed Amizadeh, and Ian Flint. "Generic and scalable framework for automated time-series anomaly detection." Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 2015.
  12. 12.Haldar, Malay, et al. "Applying deep learning to airbnb search." Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019.
  13. 13.Liu, Xiufeng, and Per Sieverts Nielsen. "Regression-based online anomaly detection for smart grid data." arXiv preprint arXiv:1606.05781 (2016).
  14. 14.Shipmon, Dominique T., et al. "Time series anomaly detection; detection of anomalous drops with limited features and sparse examples in noisy highly periodic data." arXiv preprint arXiv:1708.03665 (2017).
  15. 15.Thomassey, Sébastien. "Sales forecasting in apparel and fashion industry: A review." Intelligent fashion forecasting systems: Models and applications (2014): 9-27.
  16. 16.Greff, Klaus, et al. "LSTM: A search space odyssey." IEEE transactions on neural networks and learning systems 28.10 (2016): 2222-2232.
Download PDF
Cite This Article
CIRKIN, O. (2023). Data Warehouse, Detection and Transfer of Anomalies in Retail Data. *The European Journal of Research and Development*, 3(2), 46-53. https://doi.org/10.56038/ejrnd.v3i2.265

Bibliographic Info

JournalThe European Journal of Research and Development
Volume3
Issue2
Pages46–53
PublishedMay 31, 2023
eISSN2822-2296