Methods and systems for building a view of a dataset incrementally according to data types of user-selected data fields

Abstract

A process builds a view of a dataset. The process displays a graphical user interface window, including: a schema display region; a visualization region; and a shelf region that includes multiple shelves. The process detects user input to place a data field icon from the schema display region into the visualization region. Upon ceasing to detect the user input, the process associates the data field icon with a first shelf according to its data type and data types corresponding to other data field icons, if any, previously associated with the shelves, and then places the first data field icon within the first shelf. The method further includes determining a view type based on the data field icon and the association of the data field icon with the first shelf, and generating a graphical representation in the visualization region in accordance with the determined view type.

Claims

1. A computer implemented method for generating a graphical representation of a dataset, comprising: at a computer having one or more processors and memory storing one or more programs configured for execution by the one or more processors: detecting, via a graphical user interface, a first user selection to include a first data field in a graphical representation, the first data field having a first data type; in response to detecting the first user selection: selecting a first visualization type of a graphical representation for visualizing a portion of the dataset based on the first data type, wherein the first visualization type is selected from a plurality of predetermined visualization types; and displaying the graphical representation, having the first visualization type, in the graphical user interface, the graphical representation including a first plurality of visual marks representing data values for data fields that have been selected for inclusion in the graphical representation, including the first data field; detecting, via the graphical user interface, a second user selection to include a second data field in the graphical representation, the second data field having a second data type and the second user selection being distinct from the first user selection; in response to detecting the second user selection: selecting a second visualization type based on the first data type and the second data type, wherein the second visualization type is selected from the plurality of predetermined visualization types and the second visualization type is different from the first visualization type; and displaying an updated graphical representation, having the second visualization type, in the graphical user interface, the updated graphical representation including a second plurality of visual marks representing data values for data fields that have been selected for inclusion in the updated graphical representation, including the first data field and the second data field.

2. The method of claim 1, wherein the second data field is different from the first data field.

3. The method of claim 1, wherein: generating the updated graphical representation comprises adding color encoding to at least some of the second plurality of marks according to data in the second data field.

4. The method of claim 1, wherein the first data type is different from the second data type.

5. The method of claim 1, wherein the first data type is the same as the second data type.

6. The method of claim 1, wherein displaying the graphical representation comprises displaying visual marks, in the graphical representation, that correspond to data from one or more data fields that were previously selected for inclusion in the graphical representation.

7. The method of claim 1, wherein the first data type is selected from the group consisting of ordinal, independent quantitative, and dependent quantitative.

8. The method of claim 1, wherein the first data type is selected from the group consisting of ordinal, ordinal time, dependent ordinal, quantitative, independent quantitative, dependent quantitative, quantitative time, and quantitative position.

9. A computer system for generating graphical representations, comprising: one or more processors; memory; and one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs comprising instructions for: detecting, via a graphical user interface, a first user selection to include a first data field from a dataset in a graphical representation, the first data field having a first data type; in response to detecting the first user selection: selecting a first visualization type of a graphical representation for visualizing a portion of the dataset based on the first data type, wherein the first visualization type is selected from a plurality of predetermined visualization types; and displaying the graphical representation, having the first visualization type, in the graphical user interface, the graphical representation including a first plurality of visual marks representing data values for data fields that have been selected for inclusion in the graphical representation, including the first data field; detecting, via the graphical user interface, a second user selection to include a second data field in the graphical representation, the second data field having a second data type and the second user selection being distinct from the first user selection; in response to detecting the second user selection: selecting a second visualization type based on the first data type and the second data type, wherein the second visualization type is selected from the plurality of predetermined visualization types and the second visualization type is different from the first visualization type; and displaying an updated graphical representation, having the second visualization type, in the graphical user interface, the updated graphical representation including a second plurality of visual marks representing data values for data fields that have been selected for inclusion in the updated graphical representation, including the first data field and the second data field.

10. A non-transitory computer-readable storage medium storing one or more programs configured for execution by a computer system having one or more processors, and memory, the one or more programs comprising instructions for: detecting, via a graphical user interface, a first user selection to include a first data field from a dataset in a graphical representation, the first data field having a first data type; in response to detecting the first user selection: selecting a first visualization type of a graphical representation for visualizing a portion of the dataset based on the first data type, wherein the first visualization type is selected from a plurality of predetermined visualization types; and displaying the graphical representation, having the first visualization type, in the graphical user interface, the graphical representation including a first plurality of visual marks representing data values for data fields that have been selected for inclusion in the graphical representation, including the first data field; detecting, via the graphical user interface, a second user selection to include a second data field in the graphical representation, the second data field having a second data type and the second user selection being distinct from the first user selection; in response to detecting the second user selection: selecting a second visualization type based on the first data type and the second data type, wherein the second visualization type is selected from the plurality of predetermined visualization types and the second visualization type is different from the first visualization type; and displaying an updated graphical representation, having the second visualization type, in the graphical user interface, the updated graphical representation including a second plurality of visual marks representing data values for data fields that have been selected for inclusion in the updated graphical representation, including the first data field and the second data field.

11. The method of claim 1, wherein the first user selection is any one of: a click on a data field icon corresponding to the first data field, wherein the data field icon is displayed in the graphical user interface; a double click on the data field icon corresponding to the first data field; [and] or typing in a field name corresponding to the first data field.

12. The method of claim 1, wherein the second user selection includes any one of: a click on a data field icon corresponding to a data field of the one or more data fields; a double click on a data field icon corresponding to a data field of the one or more data fields; typing in a field name corresponding to a data field of the one or more data fields; [and] or creating a specification for a set of fields using statistical analysis, historical analysis, or heuristic algorithms.

13. The method of claim 1, wherein the graphical representation is updated in response to the user selecting the second data field and independently of additional user input detected after detection of the user selection of the second data field.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is an illustration of a computer system that facilitates the visualization of a dataset in a clear and useful form.

(2) FIG. 2 is a flowchart of the steps through which a system proceeds in one embodiment of the present invention.

(3) FIGS. 3a and 3b are illustrations of one way of presenting an embodiment of the present invention to a user.

(4) FIGS. 4a-4i are rules whereby a field may be added to an existing view or whereby a field may be used as the only field in a view.

(5) FIGS. 5a-5c are examples of different views of a single dataset.

(6) FIGS. 6a and 6b are flowcharts of the steps through which a system proceeds in another embodiment of the present invention.

(7) FIG. 7 is a table showing the criteria for forming views of a dataset and a rating system for one embodiment of the present invention.

(8) FIGS. 8a-8l are resulting views, based upon an embodiment of the present invention.

(9) Like reference numerals refer to corresponding parts throughout the several views of the drawings.

DETAILED DESCRIPTION OF THE INVENTION

(10) The present invention provides methods, computer program products, and computer systems for automatically providing a user with a clear and useful view of a dataset. In a typical embodiment, the present invention builds and displays a view of a dataset as a user adds fields to the dataset or as a dataset is accessed, such that the view is clear and useful, and is automatically presented to the user. An advantage of the present invention is that data is presented in a clear and useful form automatically.

(11) The present invention operates on a set of data, called a dataset, that are made up of tuples. As one skilled in the art will realize, the dataset can be a relational database, a multidimensional database, a semantic abstraction of a relational database, or an aggregated or unaggregated subset of a relational database, multidimensional database, or semantic abstraction. Fields are categorizations of data in a dataset. A tuple is an item of data (such as a record) from a dataset, specified by attributes from fields in the dataset. A search query across the dataset will return one or more tuples. Fields contain data that are of particular types, and each field is of a particular type. These types include:

(12) TABLE-US-00001 Data Type Symbol Ordinal O Ordinal time (date) Ot Dependent ordinal Od (categorical measure) Measure names Om Quantitative Q Independent Quantitative Qi (dimension) Dependent Quantitative Qd (measure) Measure values Qm Quantitative time Qt Quantitative position Qx
Measure names may include an ordinal field whose domain is the name of one or more Qd fields. Measure values may include a dependent quantitative field whose domain and values are the blending of the Qd fields whose names appear in the domain of measure names.

(13) A view is a visual representation of a dataset or a transformation of that dataset. Text table, bar chart, and scatter plots are all examples of types of views. Views contain marks that represent one or more tuples in a dataset. In other words, marks are visual representations of tuples in a view. A mark is typically associated with a type of graphical display. Some examples of views and their associated marks are as follows:

(14) TABLE-US-00002 View Type Associated Mark Table Text Scatter Plot Shape Bar Chart Bar Gantt Plot Bar Line Graph Line Segment Circle Graph Circle

(15) FIG. 1 is an illustration of a computer system that facilitates the visualization of a dataset in a clear and useful form. System 100 includes memory 102, CPU 180, user interface 184, storage unit 194, disk controller 192, and bus 182 that connects all of system 100's elements together. System 100 may also have network connection 196 for communication with other systems on a network. System 100 also includes memory 102, which stores operating system 104, file system 106, as well as various other modules related to the present invention. Additionally, memory 102 may also store dataset 140, which contains tuples. System 100 may also be connected to database 150 where a dataset may be retrieved and stored in memory 102. Memory 102 also stores computer program mechanisms that are necessary to some embodiments of the present invention.

(16) In FIG. 2, flowchart 200 describes the steps through which a system proceeds in one embodiment of the invention. At step 202, ordered fields selected by a user are received. A resulting view is selected at step 204, and the dataset is displayed at step 206 according to the resulting view.

(17) The computer system modules used to perform this embodiment of the invention are shown in FIG. 1. Field receiver 108 performs step 202 by receiving ordered fields selected by the user. Resulting view selector 110 performs step 204 and selects a resulting view. Dataset displayer 112 performs step 206 and displays the dataset according to the resulting view.

(18) According to one embodiment of the invention, resulting view selector 110 selects the resulting view by choosing rule(s) for adding the user selected ordered fields (step 208). This is accomplished by rule chooser 114. Rule applier 116 then applies the rule(s) to determine the resulting view's view type (step 210). In another embodiment of the invention, before rule chooser 114 chooses rule(s), view determiner 118 determines whether a first view exists (step 212). In yet another embodiment of the invention, the dataset is displayed in step 206 when mark chooser 126 chooses a mark for the resulting view (step 218), and dataset renderer 128 renders the dataset according to the mark (step 220).

(19) FIGS. 4a-4i show sets of rules that are associated with adding (or “dropping”) fields with particular data types. The field may be the only field in a view, or the field may be in addition to fields already in an existing view. When dropping a field, the field is added either as a column or a row, or it may be encoded. Encodings include color, size, and shape to represent a value. For example, red may represent all values between 1 and 10. The following convention is used for operators in the rules shown in FIGS. 4a-4i (“E” designates encoding):

(20) TABLE-US-00003 Operator Limitations =   Assign field to a clause Left hand side is a column or row +=  Add field to the end of the clause Right hand side must (some rearrangements may occur) be O or Qd *=  Blend field with column or row Right hand side (blend Qd with first E accepting/containing a must be Qd Qd). The blend will result in Qm being on column or row, and an Om being added to the view. ?   Guard the action. Only add if the Unary column or row accepts the field and the cardinality of the field is less than the cardinality associated with the column or row.

(21) The sets of rules are organized first by the type of the field that is dropped (e.g. O or Qd), and then by the type of the view that the field is being dropped onto. The rules are further broken down by the type of the view. The type of a view depends on their innermost row and column. For example, OO is a view with ordinal fields in the row and column; OQ is a view with an ordinal field in the row and a quantitative field in the column; and φ is an empty view with no fields. For each type of field being dropped, a rule table is shown containing the rules for each type of view into which the field is being dropped. The columns of the rule tables represent the contents of the innermost field on the column (X), and the rows of the rules table the innermost field on the row (Y).

(22) In step 208, rule(s) for adding the user selected field's data type are chosen. For example, if a user selected field is an ordinal, then the set of rules in FIG. 4a would be used. Or, if a user selected field is an independent quantitative, then the set of rules in FIG. 4d would be used. If in step 212 view determiner 118 determines that no first view exists, then rule chooser 114 would choose the rule in row 1 column 1 of FIG. 4a as the rule in step 208. If in step 212 view determiner 118 determines that a first view exists, and the first view contains an independent quantitative field in the innermost column and an independent quantitative field in the innermost row of the first view, then rule chooser 114 would select the rule in row 3 column 3 of FIG. 4a as the rule in step 208. Finally, in step 210, rule applier 116 applies the rule selected by rule chooser 114. If no first view exists, then the resulting view will contain a single column (Y=O). If the first view was of the QiQi type, then the resulting view will contain an encoded field (E+=O).

(23) Notes for FIG. 4a: E+=O adds to shape then color then Z. The O is always added. ?E+=O conditionally adds to shape then color. O is only added if the encoding is empty. And if the cardinality of the field is less than the cardinality supported by the encoding. In the above rules, the shape shelf is only considered if the mark is shape. Nothing is dropped on an encoding if the mark is a bar. That is, the guarded rule always fails. We try to avoid stacking of bars (more generally, nothing is dropped if we are stacking because we don't know if the field supports stacking (is additive)). The Qi row represents Qi on the Y axix. These cases are rare because Qi is normally placed on the X axis. Notes for FIG. 4b: The guard E=φ? checks whether the encoding (text or size) is empty. E*=Qd first tries to add to text then size then color then Z. ?E*=Qd first tries to add to text then size. In the above rules, the text shelf is only considered if the mark is text. An encoding accepts the Qd if it is empty or already contains a Qd. It does not accept the Qd if it contains an O. If the field accepting the encoding contains a Qd or a Qm, then the new Qd is blended with the contents to produce a Qm. If an Om is generated by the blend, it is added to the column shelf if that shelf is empty, otherwise it is added to the row shelf. The Ot rules take precedence over the O rules. The guard Y=Ot? checks whether the Y shelf contains an Ot. The Ot rows represent Ot on the Y axis. This should be rare since best practices dictate that Ot should be on the X axis. XY+=Qd converts to a matrix of scatterplots. All Qds on the rows and columns are the same.

(24) Conversions for FIG. 4b: The φφ rules will drop Qd on the Y axis, unless the text or size encoding contains a Qd. That is, if we are building a text table, continue to build a text table; otherwise make a chart. The OO rules continue to add measures to the text table. The Qiφ and QiO rules create QiQd (line) graphs. The φQd rules create QdQd scatterplots. The OQd rules create stacked charts. The QdQd rule creates a matrix of scatterplots.

(25) Notes for FIG. 4c: This set of rules is used when dropping a Qd on a pane. If no match is found, then we use the more general rules for dropping a Qd. The goal is to try to add the Qd to the encodings when Qd is dropped on the pane. The guarded version of the *=operator only adds Qd to text or size. If it can't, that operator is not applied.

(26) Notes for FIG. 4d: Always drop Qi on the X axis. But don't do it if the X axis contains a Qd. If there is an existing Qi, then the Qi's are concatenated.

(27) Notes for FIG. 4d: Always drop Ot on the X axis. If there is an existing Qi or Qd, then move the Ot leftward until all of the Q's are to the right.

(28) Notes for FIG. 4g: The += operator only adds Od to shape or color. If it can't, that operator is not applied. If no match is found, then we don't add the Od. We really want to put Od on an encoding.

(29) Notes for FIG. 4i: Do nothing if a Q is already being used. Apply Qd rules if one of the O's is an Ot. Adding a Qd makes a bar chart. Adding an Om makes a text table.

(30) The order in which fields are added affect the view type of the resulting view. For example, if a measure data type field is added to an empty view, and is subsequently followed by a dimension data type field, the resulting view will be a bar chart. However, if a measure data type field is added to an empty view subsequent to a dimension data type field, then the resulting view will be a text table. The resulting view's view type is thusly selected based upon a set of rules. The view type is then assigned to the resulting view and the view is then populated with data from the dataset. In one embodiment, the set of rules are predetermined. In another embodiment, the set of rules are based upon a user's preferences or actual usage. For example, a user may be given the opportunity to designate the best view type for various sequences of the addition of fields to views. Or, after the visual plot is populated and rendered for the user, the user is allowed to choose a different rendering. The user's choice as to the ultimate resulting view, if recorded, may indicate the user's preference for what view type the user considers the clear and/or useful. In yet another embodiment, heuristics may be used instead of a set of rules for selecting a resulting view.

(31) In one embodiment, the cardinalities of the fields in the resulting view are computed and are considered in determining how the user selected fields are added. In set theory, cardinality is the size of a set. In the present invention, cardinality refers to the number of distinct instances that are associated with a field's type. For example, if a field type is “States of America”, then the cardinality of such a field would be 50.

(32) In another embodiment, the functional dependency of the fields in the resulting view are computed and are considered in determining how the user selected fields are added. Functional dependency refers to the determination of one field by another field. For example, if one field is of the type “States of America,” and a second field is “Inches of Rainfall of the States of America,” then the second field depends upon the first. Another example is shown in FIGS. 5a-5c. Referring to FIGS. 5a-5c, there is a functional dependency from the Product field to the Product Type field because each product has a unique product type. This can be seen in FIG. 5a because each product (in the column where the product field resides) has a single product type (in the column where the product type field resides) to its right. When the columns are reversed in FIG. 5b, it is apparent that there is no functional dependency from the Product Type field to the Product Field because each product type has multiple products. Finally, when the fields that form a functional dependency are placed in both rows and columns (FIG. 5c), the resulting view contains much empty space, which makes the resulting view less effective.

(33) In yet another embodiment, in the application of the selected rule to populate the resulting view with data from the dataset, a mark is chosen for the resulting view's view type and the data from the dataset is rendered according to the mark. This is shown in FIG. 2, where, in step 218, mark chooser 126 chooses a mark for the resulting view, and data renderer 128 renders the dataset according to the mark in step 220.

(34) FIGS. 3a and 3b show ways of operating an embodiment of the present invention. A user may drag a new field from a list of available fields and drop the field onto a view. Another way of operating an embodiment of the present invention is for the user to double click on a new field from a list of available fields. This automatically adds the new field to an existing view or automatically forms a new view if there is not an existing view. Other ways of adding or dropping fields include double clicking on a field, selecting fields, typing field names, and creating a specification for a set of fields using statistical analysis, historical analysis, or heuristic algorithms.

(35) Now, referring to FIG. 6a a flowchart is provided for the steps through which a system proceeds in another embodiment of the present invention. First, alternative view former 130 forms alternative views of the tuples of the dataset (step 602). Resulting view selector 110 then selects a resulting view from the alternative views (step 604). Finally, dataset displayer 112 displays the dataset according to the resulting view (step 606).

(36) In another embodiment, alternative views are formed based upon a set of criteria. FIG. 7 is a table showing the criteria for forming alternative views of a dataset and a rating system for one embodiment of the present invention. For example, if all the data in a dataset is aggregated and does not contain any independent quantitative data, then one of the possible views is a text table as determined by the first rule. Its rating is 1 meaning that it will only be the highest ranking view if other views such as Line (Measure), which was a higher rating of 9, is not applicable to the selected fields. As one skilled in the art will realize, these ratings could also be based on other criteria such as user preference, usage patterns, and statistical analysis of the data.

(37) In one embodiment, if the user selected a first option, then the alternative views are ranked according to a rating system by alternative view ranker 134 in step 608. View assignor 120 then assigns the resulting view as the highest ranked alternative view at step 610. Dataset displayer 112 then displays the dataset according to the resulting view in step 606. For example, if all the data in a dataset is aggregated and does not contain any independently quantitative data, then alternative views of all the view types listed in FIG. 7 are generated at step 602. Then, at step 604, the text table alternative view is selected to be the resulting view, and the dataset is displayed as a text table in step 606. In another embodiment, in accomplishing step 602 (forming rated alternative views showing all tuples), view determiner 118 determines applicable view types according to the dataset's data types. Mark chooser 126 then identifies an associated mark for each applicable view type at step 620, which is then used to form alternative views for each applicable view type at step 622.

(38) In another embodiment, if the user selected a second option, then a list of alternative views would be displayed by list displayer 136 at step 622 for the user's selection. After the user's selection is received at step 624 by selection receiver 138, the resulting view is assigned as the alternative view that the user selected by view assignor 120 at step 616, and dataset displayer 112 then displays the dataset according to the resulting view in step 606.

(39) In yet another embodiment of the invention, cardinality computer 122 computes the cardinality of the fields in the plurality of tuples when forming the alternative views. In a further embodiment, functional dependency computer 124 computes the functional dependency of the fields in the plurality of tuples when forming the alternative views.

(40) FIG. 8a shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a text table, or the user selected the alternative text table view. The dataset must include only aggregated data and no independently quantitative data.

(41) FIG. 8b shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a heat map, or the user selected the alternative heat map view. The dataset must include only aggregated data, at least one field of ordinal data, one to two fields of dependent quantitative data, and no independent quantitative data.

(42) FIG. 8c shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a side-by-side bar chart, or the user selected the alternative side-by-side bar chart view. The dataset must include only aggregated data, at least one field of ordinal data, at least one field of dependent quantitative data, and no independent quantitative data.

(43) FIG. 8d shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a stacked bar chart, or the user selected the alternative stacked bar chart view. The dataset must include only aggregated data, at least two fields of ordinal data, at least one dependent quantitative data, and no independent quantitative data.

(44) FIG. 8e shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a measure bar chart, or the user selected the alternative measure bar chart view. The dataset must include only aggregated data, at least one field of ordinal data, at least two fields of dependent quantitative data, and no independent quantitative data.

(45) FIG. 8f shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a dimension line graph, or the user selected the alternative dimension line graph view. The dataset must include only aggregated data, at least one field of dependent quantitative data, at least one field of dates, and no independent quantitative data.

(46) FIG. 8g shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a measure line graph, or the user selected the alternative measure line graph view. The dataset must include only aggregated data, at least one field of dependent quantitative data, and at least one field of independent quantitative data or dates.

(47) FIG. 8h shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a circle graph, or the user selected the alternative circle graph view. The dataset must not include any aggregated data or independent quantitative data, and must include at least one field each of ordinal and dependent quantitative data.

(48) FIG. 8i shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a Gantt chart, or the user selected the alternative Gantt chart view. The dataset must include only aggregated data, at least one field of ordinal data, less than three fields of dependent quantitative data, and at least one field of independently quantitative data or of relational dates.

(49) FIG. 8j shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a single scatter plot, or the user selected the alternative single scatter plot view. The dataset must include two to four fields of dependent quantitative data, and at least one field of independent quantitative data.

(50) FIG. 8k shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a matrix scatter plot, or the user selected the alternative matrix scatter plot view. The dataset must include three to six fields of dependent quantitative data, and at least one field of independent quantitative data.

(51) FIG. 8l shows a rendering of the data in a dataset in an resulting view where either the highest ranked view type was a histogram, or the user selected the alternative histogram view. The dataset must include only aggregated and relational data, must have exactly one field of dependent quantitative data, and must have no independent quantitative data.

(52) The present invention not only accepts datasets and databases as inputs, it also accepts views as inputs. A view can be used to represent a set of fields. Resulting views can also depend on the existing view. For example, rules or operators can take into account the current view to generate a new view that is related to the current view. Also, as one skilled in the art will realize, many other rules are possible, include ones to generate statistical, maps, pie charts, and three dimensional views of data.

(53) The present invention can be implemented as a computer program product that comprises a computer program mechanism embedded in a computer readable storage medium. For instance, the computer program product could contain the program modules shown in FIG. 1. These program modules may be stored on a CD-ROM, magnetic disk storage product, or any other computer readable data or program storage product. The software modules in the computer program product can also be distributed electronically, via the Internet or otherwise, by transmission of a computer data signal (in which the software modules are embedded) on a carrier wave.

(54) Many modifications and variations of this invention can be made without departing from its spirit and scope, as will be apparent to those skilled in the art. The specific embodiments described herein are offered by way of example only, and the invention is to be limited only by the terms of the appended claims, along with the full scope of equivalents to which such claims are entitled.

(55) All references cited herein are incorporated herein by reference in their entirety and for all purposes to the same extent as if each individual publication or patent or patent application was specifically and individually indicated to be incorporated by reference in its entirety for all purposes.