Welcome to Scholar Publishing Group

Machine Learning Theory and Practice, 2022, 3(3); doi: 10.38007/ML.2022.030306.

Parallel and Distributed Optimization Algorithms for Scalable Machine Learning

Author(s)

Xin Wang

Corresponding Author:
Xin Wang
Affiliation(s)

Changchun University of Technology, Changchun 130012, China

Abstract

In recent years, the emergence of a large number of parallel data makes us pay more and more attention to how to improve the efficiency of decision-making. In this paper, scalable machine learning is the research object. First, the existing problems and development directions of existing related technologies are analyzed. Then, an extensible machine learning algorithm is introduced to solve these problems. Finally, MATLAB is used to realize the optimization simulation of n subsystems, and the regression equation between the final result and the optimal value as well as the mean square error is obtained. The corresponding conclusions are drawn. The parallel and distributed optimization algorithms of extensible machine learning run for a short time, The parallel capacity is about 3500k, and the global performance can be effectively improved by updating existing methods in the feasible region.

Keywords

Scalable Machine Learning, Parallel and Distributed, Optimization Algorithm, Algorithm Research

Cite This Paper

Xin Wang. Parallel and Distributed Optimization Algorithms for Scalable Machine Learning. Machine Learning Theory and Practice (2022), Vol. 3, Issue 3: 43-51. https://doi.org/10.38007/ML.2022.030306.

References

[1] Edoardo Vecchi, Lukás Pospísil, Steffen Albrecht, Terence J. O'Kane, Illia Horenko:eSPA+: Scalable Entropy-Optimal Machine Learning Classification for Small Data Problems. Neural Comput. 34(5): 1220-1255 (2022). https://doi.org/10.1162/neco_a_01490

[2] Manish Kumar:Scalable malware detection system using big data and distributed machine learning approach. Soft Comput. 26(8): 3987-4003 (2022). https://doi.org/10.1007/s00500-021-06492-9

[3] Florian Klemme, Hussam Amrouch:Scalable Machine Learning to Estimate the Impact of Aging on Circuits Under Workload Dependency. IEEE Trans. Circuits Syst. I Regul. Pap. 69(5): 2142-2155 (2022). https://doi.org/10.1109/TCSI.2022.3147587

[4] Prosanta Gope, Owen Millwood, Biplab Sikdar:A Scalable Protocol Level Approach to Prevent Machine Learning Attacks on Physically Unclonable Function Based Authentication Mechanisms for Internet of Medical Things. IEEE Trans. Ind. Informatics 18(3): 1971-1980 (2022). https://doi.org/10.1109/TII.2021.3096048

[5] Asiya Ashraf, Zeshan Iqbal, Muhammad Attique Khan, Usman Tariq, Seifedine Nimer Kadry, Sang Oh Park:Scalable offloading using machine learning methods for distributed multi-controller architecture of SDN networks. J. Supercomput. 78(7): 10191-10210 (2022). https://doi.org/10.1007/s11227-022-04313-w

[6] Hanan Suwi, Laaziz Lahlou, Nadjia Kara, Claes Edstrom:RAFALE: Rethinking the provisioning of virtuAl network services using a Fast and scAlable machine LEarning approach. J. Supercomput. 78(14): 15786-15819 (2022). https://doi.org/10.1007/s11227-022-04492-6

[7] Dimitrios E. Diamantis, Dimitris K. Iakovidis:ASML: Algorithm-Agnostic Architecture for Scalable Machine Learning. IEEE Access 9: 51970-51982 (2021). https://doi.org/10.1109/ACCESS.2021.3069857

[8] Esha Sarkar, Eduardo Chielle, Gamze Gürsoy, Oleg Mazonka, Mark Gerstein, Michail Maniatakos:Fast and Scalable Private Genotype Imputation Using Machine Learning and Partially Homomorphic Encryption. IEEE Access 9: 93097-93110 (2021). https://doi.org/10.1109/ACCESS.2021.3093005

[9] Prashant Singh, Fredrik Wrede, Andreas Hellander:Scalable machine learning-assisted model exploration and inference using Sciope. Bioinform. 37(2): 279-281 (2021). https://doi.org/10.1093/bioinformatics/btaa673

[10] Rodrigo Marino, Cristian Wisultschew, Andrés Otero, José Manuel Lanza-Gutiérrez, Jorge Portilla, Eduardo de la Torre:A Machine-Learning-Based Distributed System for Fault Diagnosis With Scalable Detection Quality in Industrial IoT. IEEE Internet Things J. 8(6): 4339-4352 (2021). https://doi.org/10.1109/JIOT.2020.3026211

[11] Zafer Al-Makhadmeh, Amr Tolba:SRAF: Scalable Resource Allocation Framework using Machine Learning in user-Centric Internet of Things. Peer-to-Peer Netw. Appl. 14(4): 2340-2350 (2021). https://doi.org/10.1007/s12083-020-00924-3

[12] Mir Shahnawaz Ahmad:Mitigating Malicious Insider Attacks in the Internet of Things using Supervised Machine Learning Techniques. Scalable Comput. Pract. Exp. 22(1): 13-28 (2021). https://doi.org/10.12694/scpe.v22i1.1818

[13] Gopinath Chennupati, Nandakishore Santhi, Phillip Romero, Stephan J. Eidenbenz:Machine Learning-enabled Scalable Performance Prediction of Scientific Codes. ACM Trans. Model. Comput. Simul. 31(2): 11:1-11:28 (2021). https://doi.org/10.1145/3450264

[14] Robson D. A. Timoteo, Daniel C. Cunha:A scalable fingerprint-based angle-of-arrival machine learning approach for cellular mobile radio localization. Comput. Commun. 157: 92-101 (2020). https://doi.org/10.1016/j.comcom.2020.04.014

[15] Henri E. Bal, Arindam Pal:Parallel and Distributed Machine Learning Algorithms for Scalable Big Data Analytics. Future Gener. Comput. Syst. 108: 1159-1161 (2020). https://doi.org/10.1016/j.future.2019.07.009

[16] Illia Horenko:On a Scalable Entropic Breaching of the Overfitting Barrier for Small Data Problems in Machine Learning. Neural Comput. 32(8): 1563-1579 (2020). https://doi.org/10.1162/neco_a_01296

[17] Syamasudha Veeragandham, H. Santhi:A Review on the Role of Machine Learning in Agriculture. Scalable Comput. Pract. Exp. 21(4): 583-589 (2020). https://doi.org/10.12694/scpe.v21i4.1699

[18] Valerio Morfino, Salvatore Rampone, Emanuel Weitschek:SP-BRAIN: scalable and reliable implementations of a supervised relevance-based machine learning algorithm. Soft Comput. 24(10): 7417-7434 (2020). https://doi.org/10.1007/s00500-019-04366-9