Welcome to Scholar Publishing Group

Distributed Processing System, 2021, 2(3); doi: 10.38007/DPS.2021.020305.

Structured Data Processing Method and Distributed Processing System Construction

Author(s)

Turchet Luca

Corresponding Author:
Turchet Luca
Affiliation(s)

Guys & St Thomas NHS Fdn Trust, Royal Brompton & Harefield Hosp, Harefield Resp Res Grp, London, England

Abstract

Today, data is gradually changing in popular culture in a continuous, rapid and time-varying direction. According to the new application framework, people put forward higher requirements for the performance and functions of data systems, and also put forward higher requirements for the practice and understanding of data processing. This paper aims to study the processing method of structured data and the construction of distributed processing system. This paper first analyzes the research status of distributed data systems at home and abroad, then designs a typical distributed data processing system and discusses two basic technologies of the system, and finally applies it to the project of postal centralized delivery system. This paper summarizes the structural and linguistic features of the text. According to these characteristics, this paper proposes an organizational structure. The method has three main parts: text prioritization, new text discovery and information extraction. This paper analyzes the characteristics and memory space allocation of continuous query, and designs a dynamic window query based on the greedy principle, which improves the efficiency of continuous query processing. Proven by experiment. The new word rate with a word length of more than 5 is 0%. In the case of different data volumes, the load change rate of the system is less than 0.05, and the system is stable.

Keywords

Structured Data, Distributed Processing System, Text Preprocessing, Information Extraction

Cite This Paper

Turchet Luca. Structured Data Processing Method and Distributed Processing System Construction. Distributed Processing System (2021), Vol. 2, Issue 3: 41-48. https://doi.org/10.38007/DPS.2021.020305.

References

[1] Grembowski D, Ingraham B, Wood S, et al. Statewide Evaluation of Washington's State Innovation Model Initiative: A Mixed-Methods Approach.. Population health management, 2021, 24(6):727-737. https://doi.org/10.1089/pop.2020.0374

[2] Zhou X G, Gong R B, Shi F G, et al. PetroKG: Construction and Application of Knowledge Graph in Upstream Area of PetroChina. Journal of Computer Science and Technology, 2020, 35(2):368-378. https://doi.org/10.1007/s11390-020-9966-7

[3] Lin W D, Lei L Y, Ting R D, et al. Research on massive information query and intelligent analysis method in a complex large-scale system. Mathematical biosciences and engineering : MBE, 2019, 16(4):2906-2926. https://doi.org/10.3934/mbe.2019143

[4] Strzalka D. CGraph: a distributed storage and processing system for concurrent iterative graph analysis jobs. Computing reviews, 2019, 60(12):463-463.

[5] Nanayakkara S, Perera S, Senaratne S, et al. Blockchain and Smart Contracts: A Solution for Payment Issues in Construction Supply Chains. Informatics, 2021, 8(2):article 36. https://doi.org/10.3390/informatics8020036

[6] Solonar A S, Khmarski P A. General construction principles and performance features of trajectory processing by data from one radar data source. Journal of Physics: Conference Series, 2021, 1864(1):012138 (9pp).

[7] Gu J, Li Z. Research on Data Secure Transmission and Processing Method of a LoRa IoT System. Journal of Physics: Conference Series, 2021, 1802(3):032044 (10pp).

[8] Li Y, Li Q, Shen W, et al. Research on the Layout and Data Processing Method of Distributed Optical Fiber in Shield Tunnel Monitoring. Journal of Physics: Conference Series, 2020, 1626(1):012012 (6pp).

[9] Tsingas C, Almubarak M S, Jeong W, et al. 3D distributed and dispersed source array acquisition and data processing. The Leading Edge, 2020, 39(6):392-400. https://doi.org/10.1190/tle39060392.1

[10] Mahdi H. Implementing QFD in decision making for selecting the optimal structural system for buildings. Construction Innovation, 2020, Vol. ahead-of-print(No. ahead-of-print):16.

[11] Han S, Choi J I, Woo G. Case Studies and Trends in Data Reproduction and Distributed Processing using Event Sourcing and CQRS Pattern. Journal of KIISE, 2020, 47(12):1101-1110. https://doi.org/10.5626/JOK.2020.47.12.1101

[12] Konikov A I, Fedoseeva T A. Analog-to-digital data processing tools in the construction industry and in the transportation sector. IOP Conference Series: Materials Science and Engineering, 2020, 918(1):012069 (7pp).

[13] Kostikov Y A. Development of an information system for distributed processing of streaming data. International Journal of Advanced Trends in Computer Science and Engineering, 2020, 9(3):3853-3864.

[14] Christopher G B, Kabari L G. Hybridized Concurrency Control Technique For Transaction Processing In Distributed Database System. Artificial Life and Robotics, 2020, 9(9):118-127.

[15] Ha Y S, Park S Y, Lee D H. Construction on Lot Tracking System for Failure Cost Reduction of a Small and Medium Precision Parts Processing Company. Journal of Society of Korea Industrial and Systems Engineering, 2019, 42(3):80-88. https://doi.org/10.11627/jkise.2019.42.3.080

[16] Cheolgi, KIM, Daechul, et al. An Efficient Block Assignment Policy in Hadoop Distributed File System for Multimedia Data Processing. IEICE Transactions on Information and Systems, 2019, E102.D(8):1569-1571. https://doi.org/10.1587/transinf.2019EDL8016

[17] Benitez P, Rocha E, Talukdar S, et al. Efficiency analysis of optimal inspection management for reinforced concrete structures under carbonation-induced corrosion risk. Construction and Building Materials, 2019, 211(JUN.30):1000-1012.

[18] Thanzeel F, Balaraman K, Wolf C. Streamlined Asymmetric Reaction Development: A Case Study with Isatins.. Chemistry (Weinheim an der Bergstrasse, Germany), 2019, 25(47):11020-11025. https://doi.org/10.1002/chem.201902688