“The authors, the best minds on the topic, are breaking new ground. They show how every organization can realize the benefits of a system that can search and present complex ideas or data from what has been a mostly untapped source of raw data.”
--Randy Chalfant, CTO, Sun Microsystems
The Definitive Guide to Unstructured Data Management and Analysis--From the World’s Leading Information Management Expert
A wealth of invaluable information exists in unstructured textual form, but organizations have found it difficult or impossible to access and utilize it. This is changing rapidly: new approaches finally make it possible to glean useful knowledge from virtually any collection of unstructured data.
William H. Inmon--the father of data warehousing--and Anthony Nesavich introduce the next data revolution: unstructured data management. Inmon and Nesavich cover all you need to know to make unstructured data work for your organization. You’ll learn how to bring it into your existing structured data environment, leverage existing analytical infrastructure, and implement textual analytic processing technologies to solve new problems and uncover new opportunities. Inmon and Nesavich introduce breakthrough techniques covered in no other book--including the powerful role of textual integration, new ways to integrate textual data into data warehouses, and new SQL techniques for reading and analyzing text. They also present five chapter-length, real-world case studies--demonstrating unstructured data at work in medical research, insurance, chemical manufacturing, contracting, and beyond.
This book will be indispensable to every business and technical professional trying to make sense of a large body of unstructured text: managers, database designers, data modelers, DBAs, researchers, and end users alike.
William H. Inmon is founder, president, and CTO of Inmon Data Systems. He is the father of the data warehouse concept, the corporate information factory, and the government information factory. Inmon has written 47 books on data warehouse, database, and information technology management; as well as more than 750 articles for trade journals such as Data Management Review, Byte, Datamation, and ComputerWorld. His b-eye-network.com newsletter currently reaches 55,000 people.
Anthony Nesavich worked at Inmon Data Systems, where he developed multiple reports that successfully query unstructured data.
1 Unstructured Textual Data in the Organization 1
2 The Environments of Structured Data and Unstructured Data 15
3 First Generation Textual Analytics 33
4 Integrating Unstructured Text into the Structured Environment 47
5 Semistructured Data 73
6 Architecture and Textual Analytics 83
7 The Unstructured Database 95
8 Analyzing a Combination of Unstructured Data and Structured Data 113
9 Analyzing Text Through Visualization 127
10 Spreadsheets and Email 135
11 Metadata in Unstructured Data 147
12 A Methodology for Textual Analytics 163
13 Merging Unstructured Databases into the Data Warehouse 175
14 Using SQL to Analyze Text 185
15 Case Study--Textual Analytics in Medical Research 195
16 Case Study--A Database for Harmful Chemicals 203
17 Case Study--Managing Contracts Through an Unstructured Database 209
18 Case Study--Creating a Corporate Taxonomy (Glossary) 215
19 Case Study--Insurance Claims 219
"synopsis" may belong to another edition of this title.
Bill Inmon--the "father of data warehousing"--has written 50 books and published in nine languages on subjects such as data warehousing, database design, and architecture.
For current events, seminars, conference speaking schedules, and a lot of other information related to data warehousing, unstructured data, and textual ETL, take a look at Bill Inmon’s Web site at www.inmoncif.com.
Anthony aka “Tony” Nesavich received his master's degree in computer information technology from Regis University in Denver, Colorado. He worked with Bill Inmon at Inmon Data Systems (IDS) where he was instrumental in the development of the IDS Foundation software. Much of Tony’s contributions to IDS are discussed in this book. Tony lives in Denver, Colorado, with his wife Melissa and his faithful dog, Lola.
Excerpt. © Reprinted by permission. All rights reserved.:
There have been two environments that have grown up side by side—the structured environment and the unstructured environment. The structured environment is typified by transactions, databases, records, keys, and attributes. The unstructured environment is typified by email, spreadsheets, medical records, documents, and reports.
It is amazing that at the same time that these worlds have grown up side by side, they have grown separately. It is as if these worlds exist in alternate universes.
The world of analytics and business intelligence has grown up around structured information. With business intelligence, we have displays of information, summaries, pivots, and an entire world of analytical processing. With business intelligence, we can make sense of the numbers, facts, and figures that hide out in the systems that run our corporations.
For analyses of text—unstructured information—there is nowhere near the amount of sophistication that exists in the structured environment. In the unstructured world, a few search engines can find documents and that is about it.
Does that mean that there is no important or useful information in the unstructured environment? The answer is—of course not. There is a wealth of important and useful information in the unstructured environment, but it is not as easily recoverable as information in the structured environment. The information in the unstructured environment is much more difficult to get a handle on.
There are many reasons why textual data is more difficult to handle than structured, transaction-oriented data. The primary reason is the lack of repeatability of textual data and the lack of predictability about the contents of the data. Textual data is hard to handle because it is hard to find, and it is hard to find because it does not entail repetition to any great degree.
This book is about doing textual analytics and the technologies that can be used to do textual analytics.
Two major architectural and technological approaches to doing textual analytics are used. One approach is to look at and gather the textual data in the unstructured environment. When there, the textual data is analyzed and manipulated in the unstructured environment. The unstructured environment seems like a natural place to do textual analytics because, after all, the text resides in the unstructured environment.
The other architectural approach is to look at and gather the textual data in the unstructured environment and then bring the textual data to the structured environment to do the textual analytics there.
It might seem strange or even unnatural to take the approach of accessing and gathering textual data in the unstructured environment and then bringing the textual data to the structured environment for analytical processing; however, there are good reasons for doing exactly that.
Some of those reasons follow:
For these reasons, this book is about what is required to go to the unstructured environment, find and integrate the textual data there, and then bring the unstructured textual data to the structured environment and organize it in a meaningful manner. After the textual data is in the structured analytical environment, a new world of analyses opens up.
One of the recurring themes of this book is the need for integration of text before it is useful. In most environments and in most circumstances, text is nonhomogeneous. People might talk in English, but for all practical purposes, they speak in dialects. Before analytical processing can be done effectively, there must be a common tongue established. Analyses can be done effectively only when a common tongue is established. Stated differently, if all you do is gather text and throw it into a database, you end up with the Tower of Babel. The Tower of Babel led nowhere, certainly not up to God.
One of the requirements of textual analytical processing is accessing and analyzing text in a colloquial vocabulary and a common vocabulary. The textual analyst needs both abilities.
The classical approach to text and text processing is to use semantics and natural language processing. This book describes a different approach. Without fail, the approach taken in this book is that text—made of up of words—is just another form of data. The approach that looks at words as just another unit of data frees the analyst from the trap of context. It is true that words taken out of context can have twisted meanings in some occasions. It is also true that freeing words from context opens up the door to entirely new and novel kinds of processing that simply are not possible when having to stop and consider the context of text at every turn.
There is a tradeoff. Paying attention to context when dealing with text entails a certain set of opportunities and precision. However, freeing text from context opens up entirely new and exciting vistas.
This book assumes that words are treated as just another unit of data and does not take context into consideration in 99.99 percent of the cases.
This book is for a wide audience. It is for students of computer science, general managers, database designers, data modelers, database administrators, researchers, and end users—in short, it is for anyone facing the challenge of taking a body of text and trying to make sense of it. In addition, this book answers the questions, “How do we bridge the gap between structured and unstructured systems?” and “How do we create an integrated data warehouse that incorporates both structured and unstructured data?”
The discipline of textual analytics is in its infancy; it is entirely predictable that more discussion and more advances will be made in the future about this subject. This book represents merely the first step in what is likely to be a massive field of endeavor in years to come.
We hope that you find the book full of useful information. We hope the book at least sets you down the right path to enjoying the fruits of textual analytics.
Bill Inmon Jan 11, 2007
Tony Nesavich, Jan 11, 2007
"About this title" may belong to another edition of this title.
Book Description Prentice Hall, 2007. Paperback. Book Condition: New. book. Bookseller Inventory # 0132360292
Book Description Prentice Hall, 2007. Paperback. Book Condition: New. 1. Bookseller Inventory # DADAX0132360292
Book Description Prentice Hall, 2007. Paperback. Book Condition: New. Bookseller Inventory # P110132360292
Book Description Book Condition: Brand New. Book Condition: Brand New. Bookseller Inventory # 97801323602961.0
Book Description Prentice Hall. PAPERBACK. Book Condition: New. 0132360292 New Condition. Bookseller Inventory # NEW6.0050994