Welcome to Scholar Publishing Group

Distributed Processing System, 2021, 2(4); doi: 10.38007/DPS.2021.020403.

Design and Implementation of Distributed System Based on Machine Learning Algorithm and Numerical Simulation

Author(s)

Sivakumar Shirley

Corresponding Author:
Sivakumar Shirley
Affiliation(s)

Democritus University of Thrace, Greece

Abstract

In recent years, the Internet industry has entered a period of rapid development, and smart life has brought people a lot of experiences they have never had before. Rich application scenarios not only bring convenience to people, but also expose more and more network security problems. Network traffic types are more diversified, network security monitoring is becoming more and more difficult, and network communication quality and user host security are constantly facing the threat of network intrusion. This paper studies the current network traffic anomaly detection methods. Aiming at the problems of low accuracy and difficult real-time monitoring caused by the limitations of data scale and processing capacity in the previous methods, combined with machine learning and data simulation technology, a multi model fusion streaming parallel anomaly detection method is proposed, which enables distributed processing of massive streaming data on the basis of ensuring algorithm accuracy, At the same time, a visualization system based on network traffic anomaly detection is developed. The system can monitor the flow, and the reliability experiment can also meet the daily needs.

Keywords

Network Traffic, Machine Learning, Data Simulation, Distributed Processing

Cite This Paper

Sivakumar Shirley. Design and Implementation of Distributed System Based on Machine Learning Algorithm and Numerical Simulation. Distributed Processing System (2021), Vol. 2, Issue 4: 18-27. https://doi.org/10.38007/DPS.2021.020403.

References

[1] Ali R, Lee S, Chung T C. Accurate multi-criteria decision making methodology for recommending machine learning algorithm. Expert Systems with Applications, 2017, 71:257-278. https://doi.org/10.1016/j.eswa.2016.11.034

[2] Rindal O, Seeberg T M, Tjnns J, et al. Automatic Classification of Sub-Techniques in Classical Cross-Country Skiing Using a Machine Learning Algorithm on Micro-Sensor Data. Sensors, 2018, 18(1):75. https://doi.org/10.3390/s18010075

[3] Boland M R, Polubriaginof F, Tatonetti N P. Development of A Machine Learning Algorithm to Classify Drugs Of Unknown Fetal Effect. Scientific Reports, 2017, 7(1):12839.

[4] Yu J, Hall J J, Yu T M. Automatic Equatorial GPS Amplitude Scintillation Detection Using a Machine Learning Algorithm. IEEE Transactions on Aerospace & Electronic Systems, 2017, PP(1):1-1.

[5] Park B J, Kang M S, Lee M, et al. A Study on Efficient Memory Management Using Machine Learning Algorithm. International journal of advanced smart convergence, 2017, 6(1):39-43.

[6] Comertpay B, Gov E. Identification of molecular signatures and pathways of obese breast cancer gene expression data by a machine learning algorithm. Journal of Translational Genetics and Genomics, 2021, 6(1):84-94. https://doi.org/10.20517/jtgg.2021.44

[7] Teluguntla P, Thenkabail P S, Oliphant A, et al. A 30-m Landsat-derived Cropland Extent Product of Australia and China using Random Forest Machine Learning Algorithm on Google Earth Engine Cloud Computing Platform. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 144(OCT.):325-340.

[8] Gao J, Nuyttens D, Lootens P, et al. Recognising weeds in a maize crop using a random forest machine-learning algorithm and near-infrared snapshot mosaic hyperspectral imagery. Biosystems Engineering, 2018, 170:39-50.

[9] Cho M J, Hallac R R, Effendi M, et al. Comparison of an unsupervised machine learning algorithm and surgeon diagnosis in the clinical differentiation of metopic craniosynostosis and benign metopic ridge. scientific reports, 2018, 8(1):6312. https://doi.org/10.1038/s41598-018-24756-7

[10] Alhudhaif A, Cmert Z, Polat K. Otitis media detection using tympanic membrane images with a novel multi-class machine learning algorithm. PeerJ Computer Science, 2021, 7(7):e405. https://doi.org/10.7717/peerj-cs.405

[11] Richter C, Petushek E, Grindem H, et al. Cross-validation of a machine learning algorithm that determines anterior cruciate ligament rehabilitation status and evaluation of its ability to predict future injury. Sports biomechanics, 2021:1-11.

[12] Allen A, Ektefaie Y, Garikipati A, et al. Sa102 A Machine Learning Algorithm To Predict Gastrointestinal Bleeding Requiring Intervention. Gastroenterology, 2021, 160(6):S-422.

[13] Turnquist M, Lewis P, Lau T, et al. Adaptive Focused Ion Beam Milling through Machine Learning Algorithm Integration. Microscopy and Microanalysis, 2021, 27(S1):1624-1624. https://doi.org/10.1017/S1431927621005985

[14] Zoss B M, Mateo D, Kuan Y K, et al. Distributed system of autonomous buoys for scalable deployment and monitoring of large waterbodies. Autonomous Robots, 2018(11):1669-1689.

[15] Hillah L M, Maesano A P, Rosa F D, et al. Automation and intelligent scheduling of distributed system functional testing. International Journal on Software Tools for Technology Transfer, 2017, 19(3):281-308. https://doi.org/10.1007/s10009-016-0440-3

[16] Siami M, Skaf J. Structural Analysis and Optimal Design of Distributed System Throttlers. IEEE Transactions on Automatic Control, 2017, PP(99):1-1.

[17] Srivastava A K, Kumar S. Dynamic Reconfiguration of robot software component in real time distributed system using clustering techniques. Procedia Computer Science, 2018, 125:754-761. https://doi.org/10.1016/j.procs.2017.12.097

[18] Nesterov R A, Lomazova I A. Using Interface Patterns for Compositional Discovery of Distributed System Models. Proceedings of the Institute for System Programming of RAS, 2017, 29(4):21-38. https://doi.org/10.15514/ISPRAS-2017-29(4)-2