 |
Data Integration
is a new component in BlueQuery Enterprise V. It is a data integration
platform globally best in view to its efficiency and expansibility. In
application of this platform, your enterprise can easily realize data
integration, including Data Extraction, Transformation and Loading, while
ensuring the correctness and integrity of the data. For ocean data, multiple
high-end innovative technologies are used to help the enterprise enhance
the data integration efficiency.
It is pointed out
in Data
Warehouse vs. Database (refer to the article for detail) [Software World,
2005-06-10] that
from the generalized application of the data warehouse, the database
application is mainly oriented to business processing and the data warehouse
is oriented to online analysis processing, including integration of data
from multiple sources, data storage, generation of multi-dimensional data,
data presentation, smart analysis and data mining, etc. With the application
of data warehouse developing toward the full enterprises and increasing
demands for online search, change requirements are put forward for
the efficiency other than the data updating efficiency, huge data are
being inquired and the inquiry is becoming more complicated. The data
integration provided by BlueQuery is such an complete integrated solution.
Two modules for data
integration:
|
InfoSphere
Technology
The semantic tier technology creates its data warehouse via Infosphere.
Via Infosphere, the forms and filed names of the database can
be transformed into the language (Chinese, English or etc.) you
understand, and they are further categorized so that the enterprise
user can create value more quickly from BI (business intelligence)
project. This is because they can extract data from UFIDA, Kingdee,
QAD¡¢SAP¡¢ Oracle and Siebel applications by using the pre-built data
model, transformation logic and data stream.
|
|
|
|
Ultrahigh-speed
ETL Engine
Today, the key to success of a business intelligence (BI) product
is how to transform the data, no matter where the data are and in
what format. BlueQuery ultrahigh-speed ETL engine provides
the most powerful ETL data integration platform for the enterprises.
Since Sunnet was successful to make general ETL engine able to support
Oracle, SQL Server, Informix, DB2, Sybase, Progress and other relational
database at the end of 2002, we have spent other 3 years to develop
out ultrahigh-speed ETL engine coded 'BlueQuery - P', which
was officially presented to the market in January 2006.
Blue-Query -
P Ultrahigh-speed ETL Engine developed by Sunnet is currently able
to support Oracle and SQL Server only. The extraction and loading
test indication for Oracle and SQL Server is 1 million lines of
data covering 18 fields of various types, at least 10 times faster
than Microsoft DTS.
|
|
|
|
|
Powerful Functions: |
1. Provide
one-stop data warehouse services ranging from creation to production,
reporting and platform.
2. Simple and quick ETL engine.
3. Localized ETL engine finds a solution to Chinese code confusion,
e.g. transformation of UTF8 code.
 |
|
| Before
using BlueQuery Skill Sets |
|
 |
|
| After
using BlueQuery Skill Sets |
|
 |
|
|
Problem
Solved (1): How does BQ ETL engine solve the problem of
headache UTF8 messy code?
|
|
|
|
It
is a common problem that the Chinese words will appear in
messy code if Oracle database character set is UTF8.
It is found of the same problem after we test with Cognos,
Business Object, Crystal Report and Qianrui Reporting.
Through our technicians' research, we find a solution, but
cannot use the prevailing general driver like OLE DB, ODBC
or JDBC. We must develop special driver, that is, Native
Driver (Today, the new-version ultrahigh-speed ETL engine
for BQ just uses this type of driver). The new driver can
not only solve the problem of UTF8 messy code, but also
result into significant increase of Oracle's query performance.
Subject to tests from many aspects, BQ Oracle Native Driver
can properly solve the problem of messy code, achieving
the same result as Oracle SQL Plus. Compared with Oracle
SQL Plus, it is advantaged in that:
It is unnecessary to change the setting of character set
in REGEDIT. Different setting of character set can be made
in the program according to different databases separately
without mutual interference, hence to allow coexistence
of the data sources for character set on multiple different
Client end. However, Oracle SQL Plus must rely on the setting
of current REGEDIT and cannot change the setting of character
set once started. After changing the REGEDIT, the user must
be exit Oracle SQL plus before entering again.
Click View
to find out how BlueQuery accomplishes the data integration.
|
|
|
