Telecom companies participate in competition cutlery - Data Warehouse and Data Mining Based on Sybase Guangdong Telecom Data Warehouse Solution Guangdong Telecom Science and Technology Research Institute
1 Overview With the opening of the telecommunications market, competition will become more and more intense. The reduction in profits enables transition from extensive operation to intensive operations, while operating decisions require as much quantitative basis and as fast as possible. All of these needs technical support ---- Data Warehouse and Data Mining Guangdong Telecom Science and Technology Research Institute is the highest technical department of communication technical support and scientific research and development in South China, running safely, efficient and communications markets around the security communication network. Demand for system maintenance support, network management system development, multimedia research, network technology and market research, billing system research and development, personnel training and measurement testing and other seven aspects of work. The Institute currently has a strong and strong research and development team with more than 900 people. The Thinker-BC2000 Multimedia Network Integrated Business Management System developed by the Institute is a unified integrated business management system. It provides a stable and flexible business support platform for telecom operators and ISPs at all levels. This platform provides all multimedia data communication basic services and various value-added services, which have highly scalable, with fast new business generation, promotion capabilities. The system can flexibly define tariff policies for all services, and bundled sales preferential strategies for various services, and provide accurate and real-time billing function on various services. The data warehouse decision support system is developed based on Sybase's data warehouse solution. Business management decision makers can use this system to quickly and accurately understand the development of various services and provide a solid foundation for further decision-making support. 2 main features
The amount of data is large, and the total number of private multimedia communication networks in Guangdong has reached 700,000. According to business demand analysis, the total number of users in Guangdong 163/169 network to 2002 will reach more than 8 million, including 4 million of the dial-up registration users, 3 million caller users, 1 million card users, and special line users will reach 10,000 households. the above. Many important information is hidden behind these large amounts of data. The end user of the business structure complex system is various departments within the telecommunications, so the demand for end users is not the same. Regular changes in business strategies are constantly changing. Performance as the continuous change of tariff policies. 3 Scenario Data Warehouse System Model of Thinker-BC2000 Multimedia Network Integrated Business Management System As shown in the figure: 3.1 Implementation of the system software platform data warehouse is a fairly complex process, mainly including five parts: data warehouse design Modes, data conversion and integration, data storage and management, data analysis and display and maintenance and management of data warehouses. Sybase provides a complete set of product packages covering the entire data warehouse establishment cycle: Warehouse Studio, which includes data warehouses modeling, data integration, and conversion, data storage, and management, metadata management, and data visual analysis. The following explains how we are combined with Sybase's products to do data warehouse design and development.
The design of the data warehouse, the design of the modeling data warehouse plays a vital role in decision support system, it needs to determine the subject according to decision requirements, from data source to data, logical structure of data organizations in data warehouses Further, organize and provide information according to the user's most understandable manner. At this stage, we used PowerDesigner WarehouseArchitect. WarehouseArchitect is a highly optimized database tool, which is widely used in the reverse engineering, modeling, data warehouse scheme design of data sources to accommodate each business needs. The WarehouseArchitect is convenient for development and implementation of data warehouses by integrating logic design, physical design and application modeling.
Data conversion and integration are the establishment of data warehouses, one of the biggest challenges is how to translate the original business data into a consistent format, making it better for decision support services. This includes verifying, purifying, purifying, extracting, transforming, loading data, or data warehouses, and regular updates and management of data. Powermart as a data extraction tool, extracting data from a variety of data sources, in the data extraction process, the user can flexibly customize the various data extraction flows according to different extraction phases, and load the data into the data warehouse timed. Powermart is an integrated software product kit for building and managing data marts and analytical applications. Powermart delivers an open scalable solution, mainly positioned in the complete lifecycle and analysis of application development and product management in data fairs, which can support a large amount of data on a variety of platforms as data source, complex Conversion processing and support high-speed data load. Its Metadata Repository can coordinate and drive a range of core functions, including extraction, conversion, loading, and management. Powermart's graphical user interface helps data warehouse managers easily design complex Source-To-target mappings, and then can be executed by powermart powerful servers. Data Storage and Managing Data Warehouses can be used with multi-dimensional databases, or you can use a relational database or other special storage. The storage of data ensures the security, integrity, consistency of data, and also has complex analysis of the efficiency of the query. We selected Sybase's data warehouse products Adaptive Server IQ. Adaptive Server IQ is a relational database that optimizes high-performance decision support and data warehouse. Key Technologies in IQ are longitudinal data storage (through columns rather than through rows), bit-wise query indexes and data compression.
Data analysis and display online analysis processing (OLA) is an analysis processing technology that collects information from the business data collection, and uses mathematical operations and data processing technology, flexible, interactive, and interactive statistics, trend analysis, and forecast reports. Multi-dimensional analysis, summary, formation, or report form in the data warehouse is made by a variety of OLAP tools, so that the decision makers can clear and intuitively see the results of the analysis, which is the purpose of the data warehouse system. The development and application of data warehouse mainly has structural design, data centralized organization and management, and quick and efficient access to data. Among them, access is generally completed by a more mature business intelligence tool, so different from the OLTP system, the front-end development program of the data warehouse system is relatively small, but its maintenance work has a large span, because decision support application Strong of interest, it is impossible to fix a unified mode of operation like the business system. As a business intelligence provider that enters the Chinese market, BusinessObjects has a streamlined product operation, rich in function, and has an intuitive front-end display metadata management section, which is complement to the high-speed query efficiency of IQ.
The maintenance and management metadata of the data warehouse is data about the data, which can represent the meaning of the data and the relationship between the relationship between the components of the system. It includes keywords, attributes, data descriptions, physical data structures, source data structures. , Mapping and conversion rules, integrated algorithms, code, default, security requirements, and data time limits. Managing metadata is the key to managing data warehouses. Sybase's Warehouse Control Center provides a guarantee technology for data warehouse solutions through centralized management of metadata warehouses. From design and development to end user access, intensive integration and management of metadata generated by tools and databases guarantee the establishment of the real enterprise-class data warehouse. Warehouse Control Center is based on the data warehouse metadata management tool provided by the data warehouse developer, which can perform data acquisition, capture, storage, management, and publish logic, physical and context-related information in data warehouse environments. The physical storage location without deregulation is on a joint data warehouse, and both of the distributed data warehouse is also there. Business users can browse the metadata objects generated based on their needs, and even use published and registration performance requests or select additional performance. 3.2 System Hardware Platform Data Warehouse Server: SUNE5500 / 8 CPU / 4G RAM / 18G Hard Drive Run Sybase IQ. Data Migration Server: IBM Netfinity7600 Intel Piii550 / 4 CPU / 1G RAM / 36.4 G HD NT4 Runput PowerMart Server Management Web Server Two: IBM Netfinity7600 Intel PIII550 / 4 CPU / 1G RAM / 36.4 G HD NT4 Run Bo Web Intelligence and Warehouse Control Center Server. Storage Network: Main features of the SAN system 3.3 system using Veritas
Data Warehouse and Decision Support System Effectively isolates online transaction application and online statistical analysis applications. It is guaranteed that the service management system is safe, stable, reliable, and efficiently operated in the service management system, ensuring that the decision support system can quickly and timely obtain statistics. Provincial center and city business managers can generate a pre-defined standard statistical report per month. The business analyst can quickly accurately query the semantic layer inquiry and quickly present the required business data, information, and analysis results in a rich form, providing accurate basis for leadership decisions. Provide data mining capabilities to excavate potential factors that affect business development. Provide services for customer management systems to provide customers with fast bills and various service list queries. And provide a means of excavating big customers. 4 Conclusion We have successfully implemented a data warehouse system on the Internet, using Sybase's data warehouse solutions, and developed a statistical analysis report system based on BO (Business Object). Currently, a new generation of multimedia network integrated business management systems in Guangdong Province is building, including new versions of data warehouse systems. And this data warehouse system is also a data warehouse solution using Sybase.
