SmartCore big data solution is based on SmartCore big data integration machine, provides the full range of data collection and storage, analysis and mining large data show the integrated solutions to help customers data base platform to support fast implementation of multi-source data integration, data mining new value; reduce the data calculation time, improve business efficiency; to achieve the expansion of online, improve the system stability.
Big data market demand is in a period of outbreak, the rapid development, the major industries want to accelerate the traditional industry digital, intelligent, bigger and stronger digital economy, provide new impetus for industrial transformation and upgrading. Big data demand, in finance, telecommunications, government, medical, energy and other industries have started, and gradually extended to other industries.
The financial industry informatization popularization, online trading volume surged, the urgent need for the personalized trading supervision and analysis, fraud detection, driving new business, the financial industry needs new methods and techniques to solve these problems, to deal with the challenges of big data, in order to meet the new requirements, to promote sustained and rapid business development. The telecom industry needs to realize real-time billing and reminding of the traffic, optimize the data flow tariff system, reduce the tariff level difference between the inside and outside the package, improve the fine marketing ability, and constantly improve customer satisfaction. Through the big data analysis platform to radio and television companies, viewing behavior data collection all users, all business users, the establishment of a complete set of data analysis and mining mechanism, to better understand the needs of users, and promote the development of the business. Health care industry needs to get effective insight through governance and analysis of huge data, and further use of these information to help hospitals achieve management transformation, towards modernization.
However, due to the large data related technology update speed, high technology threshold, most of the traditional industry in this area accumulated insufficient, big data transformation process only rely on its own strength, difficulties, high cost. Therefore, I hope relevant manufacturers provide mature big data products and integrated solutions.
The heterogeneous data, large amount of data and the inconsistent processing time of various services bring great challenges to big data processing. Single large data processing technology cannot meet the needs of big data processing. The SmarCo big data machine system based on Internet data, third party data organization, data as the main data source, the data model definition and analysis topic index, and ETL data acquisition and conversion to establish thematic analysis library. Using the current mainstream technology architecture, technology tools of self-control, advanced distributed architecture can be extended; through the level of computing equipment and storage equipment, to achieve the level of resources to expand; the combination of the front-end display mode can realize diversified, flexible and fast business information display, analysis the business operation of the theme, aided management decision. SmartCore big data processing platform has the ability to complete large data acquisition, integration, storage, processing, analysis, display and management
SmartCore big data platform framework
SmartCore big data integration machine is out of the box with the integration of software and hardware products, the built-in SmartCore SmartBD suite, the combination of hardware and software tuning enhance the processing ability, high throughput, high flux data collection of real-time and efficient fusion extensions, for big data applications fast, efficient and stable landing delivery, can provide from the data management and analysis platform, computing platform to big data solution framework and in the realization of the scale of the application of financial, telecommunications, public security, industry and commerce, transportation, health and other industries, enterprise users.
SmarCo big data all-in-one machine
SmartCore big data platform provides a unified data bus, the increase of unstructured data, streaming data, Internet data support on the basis of traditional ETL through real-time data preprocessing or single batch data processing script, complete synchronization of data cleaning, weight, marking sign, indexed and distributed control and management the construction of big data system.
In the aspect of data storage, data integration platform to the platform, according to the data using the distributed storage technology of different storage environment, makes the whole data have high scalability and extensibility, meet the scalability of data storage and future hardware rationality. In addition to the traditional database, the platform also includes a KV column type data storage for structured data, the design model was similar with traditional database; for semi-structured data, allowing developers to customize the data model, to provide a variety of data access methods.
On the data computing level, the platform adopts a distributed and scalable computing and scheduling architecture. The use of off-line computing scheduling tasks to operate a large batch of static data, suitable for real-time requirements of the scene; using flow calculation, when the data will be carried out immediately after the arrival of calculation, get the value in the effective time, mainly used in real-time monitoring system, real-time search, recommendation, spam processing scenarios; the use of memory calculation. The data in the memory, in the implementation process without I/O, improve the operation efficiency and performance; the use of graph processing abstract distributed storage, parallel computing and other complex problems, the extraction of useful information from massive data in high noise.
At the data processing level, machine learning is used to provide a convenient and interactive interface to facilitate off-line batch prediction or online real-time prediction. The prediction process runs in the distributed system, and the iterative calculation based on memory can predict the massive data and has strong scalability. Aiming at the prefabricated values, manual adjustment and modification are allowed to ensure the accuracy of data reading, thus improving the prediction hit rate. Support mature, rich data mining algorithm, can generate classification, aggregation, regression model, applied to medical, education, the Internet, communications, finance and a variety of industries.
The SmartCore puts mainstream of new data processing technology, analysis model, service concept and others into products, so customers in various industries can quickly build data platform for the product safety and reliability, high efficiency and intelligence based on the fast implementation of digital and intelligent traditional industries, bigger and stronger digital economy, provide a new impetus for industrial transformation and upgrading. The main advantages of SmartCore is：
l High operating efficiency. The rapid integration of multi-source data, improve data sharing and information linkage operation efficiency, the value of data mining; using the parallel processing architecture, memory computing multiple mechanisms, to ensure the data loading, calculation, access link data processing to maximize efficiency, improve business efficiency.
l Strong system stability. Support online expansion, cluster online expansion, support data storage, loading and query performance of linear growth, with multi-level fault tolerance, automatic detection and automatic recovery mechanism, to ensure system security and availability.
l Have the ability to analyze big data. On the basis of multi-source data, combined with intelligent search, deep learning, automatic and efficient retrieval and prediction, improve the efficiency of data sharing, mining new data business value, support decision management.
l Through high-throughput
SmartCore big data integration machine equipped with multiple CPU, multiple GPU / SmartSys co loaded Media accelerator, form hundreds of kernels scale of heterogeneous platforms, support high concurrent threads application, through the realization of high concurrent data service.
l Customization level flexible matching
Support up to 8 GPU accelerator card at the same time, SmartSys-Media audio and video accelerator card and the different structure of the deep learning accelerator, based on user's practical application scenarios to achieve seamless handover and combination, to achieve high efficiency of the custom class.。
l Integration and efficient extension
Big data integration machine is based on the fusion architecture, pre integration and pre optimization of hardware and software is carried out. The new distributed parallel computing architecture can be extended horizontally to thousands of nodes to form a powerful computing and processing capability. Using component-based delivery, the cumbersome big data environment construction process is completed in the production line, out of the box, easy to deploy, just plug in, connect the network, start a few simple steps to start using. The embedded server system remote monitoring module, real-time monitoring, the stability of the system provides a key technology to build and upgrade various heterogeneous management function; modular architecture based on modularization, open the chassis support free operation, convenient maintenance and upgrading, and greatly reduce the maintenance and upgrade.
l Enterprise level enhancement
Intelligent cooling system is adopted to effectively reduce noise pollution and create a constant temperature space; full shielding, anti-radiation, anti-interference, anti-static design. Selecting military grade raw materials, long-term stable operation at 35 degrees of high temperature environment, ensure stable and reliable high throughput applications from CPU, memory, bus, I/O.