System and Method for Generating Decison Confidence Index Scores and Bias Assessment Scores fort Interactive Decision-Making
20230065338 · 2023-03-02
Inventors
Cpc classification
G06F18/2137
PHYSICS
International classification
Abstract
A computer-based decisioning tool is disclosed that enables the generation of Bias Assessment Scores to indicate a level of hidden or unconscious bias an individual being tested may have and enables the generation of Confidence Index Scores the indicate the best choices for making three types of decisions, which are searching/match decisions, comparison decisions, and binary (Yes/No) decisions.
Claims
1. A computer-based method for generating a bias assessment score that is indicative of a level of at least hidden or unconscious bias with regard to a specific subject area, comprising the steps of: A. selecting a potential bias subject area that a first individual may have hidden or unconscious bias; B. develop a computer-based template that includes at least one bias profile statement directed to the potential bias subject area, at least one bias object that is a first level of statement below the bias profile statement directed to the potential bias subject area, and at least two bias dimension statements that are a first level of statement below the bias object statement and a second level of statement below the bias profile statement directed to the potential bias subject area, with each bias dimension statement including at least two parts for which the first individual is capable of providing a response to each part on a predetermined scale and uploading the template to a database of a system computer that is accessible by the first individual, wherein the first part of the two parts includes a question for a response is needed and the second part is an importance of the first part question to the first individual; C. the first individual downloading the template and separately recording a response along the scale of each of the two parts of each of the two bias dimension statements and uploading the responses to the system computer; D. the system computer generating a bias assessment score indicative of the level of at least hidden or unconscious bias in the first individual by i. receiving inputs for a system dimension importance score for each bias dimension, a system object dimension score for the bias object, and an ideal object importance score, ii. determining a bias dimension score for each bias dimension by determining a product of the first part score, the second part score, and the system dimension importance score, with a result being a first bias dimension score and a second bias dimension score, iii. determining a bias object score by summing the first and second bias dimension scores, iv. determining a bias profile score by summing the bias object score with any additional bias object scores and if there is just the bias object score at step D(iii), the bias profile score equals the bias object score, and v. determining the bias assessment score for the first individual as a percentage by subtracting an absolute value between the bias profile score and the ideal object importance score from the ideal object importance score and then divided by the ideal object importance score and multiplying by 100.
2. The method as recited in claim 1, wherein the bias object statement includes a question.
3. The method as recited in claim 1, wherein the predetermine scale for first and second parts of each bias dimension includes a range.
4. The method as recited in claim 3, wherein the ranges for each bias dimension is capable of being divides into sub-ranges.
5. The method as recited in claim 4, wherein each sub-range is capable of being assigned a value for determining the bias assessment score.
6. The method as recited in claim 3, wherein each range includes having a portion thereof as acceptable for selection of a score that is capable value for determining the bias assessment score.
7. The method as recited in claim 3, wherein ranges for the first part of the bias dimension statement includes numeric or percentage ranges.
8. The method as recited in claim 3, wherein ranges for the second part of the bias dimension statement includes percentage ranges.
9. A computer-based decision-making method for generating a confidence index score to indicate a best decision option, comprising the steps of: A. a system user selecting a decision type to conduct a decision; B. the system user defining the subject area for which a decision is sought; C. the system user defining sourcing for potential decision targets in the defined subject area and generating a searchable computer database for identifying potential target; D. the system user developing a computer-based template that includes at least one decision profile statement directed to the decision subject area, at least one decision object that is a first level of statement below the decision profile statement directed to the decision subject area, and at least two decision dimension statements that are a first level of statement below the decision object statement and a second level of statement below the decision profile statement directed to the decision subject area, with each decision dimension statement including at least two parts for which the first individual is capable of providing a response to each part on a predetermined scale and uploading the template to a database of a system computer that can be retrieved the system user for transmission to decision targets, wherein the first part of the two parts includes a question for a response is needed and the second part is an importance of the first part question to a decision target; E. the system user searching the target's searchable database with the decision profile, decision objects, and decision dimensions for matching decision targets, and receiving matched decision targets ranked by confidence index scores with the confidence index score for each decision target being determined by i. a system computer receiving for each decision target a target's scores for the first and second parts of each decision dimension statement, the system user's importance score for each decision dimension, and an ideal target object importance score, ii. the system computer determining a decision dimension score for each decision dimension by determining a product of the first part score, the second part score, and the system user dimension importance score, with a result being a first decision dimension score and a second decision dimension score, iii. determining a decision object score by summing the first and second decision dimension scores, iv. determining a decision profile score by summing the decision object score with any additional decision object scores and if there is just the decision object score at step E(iii), the decision profile score equals the decision object score, and v. determining the confidence index score for each decision target as a percentage by subtracting an absolute value between the decision profile score and the ideal target object importance score from the ideal target object importance score and then divided by the ideal target object importance score and multiplying by 100, F. the computer system ranking the decision targets by confidence index scores and transmitting the ranking to the system, and if the system user selects the decision target with the highest confidence index score, then end the process, otherwise step G; G. the system user sending addition one or more additional questions to one or more decision targets and generating new confidence index scores according to step D for the decision targets and ranking the decision targets according to the new confidence index scores; and H. repeating steps F and G until the system user selects a decision target.
10. The method as recited in claim 9, wherein the decision object statement includes a question.
11. The method as recited in claim 9, wherein the predetermine scale for first and second parts of each decision dimension includes a range.
12. The method as recited in claim 11, wherein the ranges for each decision dimension is capable of being divides into sub-ranges.
13. The method as recited in claim 12, wherein each sub-range is capable of being assigned a value for determining the confidence index score.
14. The method as recited in claim 11, wherein each range includes having a portion thereof as acceptable for selection of a score that is capable value for determining the confidence index score.
15. The method as recited in claim 11, wherein ranges for the first part of the decision dimension statement includes numeric or percentage ranges.
16. The method as recited in claim 11, wherein ranges for the second part of the decision dimension statement includes percentage ranges.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
DESCRIPTION OF THE PRESENT INVENTION
[0068] The present invention is a system and method directed to a computer-based decisioning tool that is capable of carrying out two distinct functions in a single tool. These functions include generating (1) numeric bias assessment scores for measuring the level of an individual's or Organization member's unconscious or hidden bias measured against acceptable numeric societal ranges generated by SMEs and (2) decision-making numeric confidence index scores for ranking which of a number of decision options is best for a system user to take given the current circumstances associated with each option, the user's goals and priorities, and any interactive communications between the system user and the potential target in the decision-making process.
[0069] The intent of the bias assessment according to the present invention is to identify the level of hidden or unconscious bias that a person may have. This may be done by an individual in his/her own capacity or When that person is a member of an Organization. As stated previously, as used herein, an “Organization” is meant to be representative of institutions, affinity groups, governmental agencies, for-profit/nonprofit corporations ranging from small businesses to large enterprises.
[0070] As will be described in greater detail herein, the decisioning tool of the present invention will carry out both bias assessment and decision-making processes through the use of Profiles, Objects, and Dimensions. For clarity, the respective “Profiles” for these two distinct functions of the decisioning tool will hereinafter be referred to as “Bias Profiles” and “Decision Profiles” to prevent confusion. The difference between the two Profiles types is a “Bias Profile” preferably is what is generated based on the person being assessed's answers to a series of questions from a SME template for identifying hidden or unconscious bias, while “Decision Profile” preferably includes a number of system user created Decision Objects inquiries and Decision Dimensions inquiries for generating a decision.
[0071] Following the differences between two types of Profiles, the Objects and Dimensions for bias assessment and decision-making also differ. “Bias Objects” and “Bias Dimensions” are respectively questions and sub-questions created by the SME and part of the SME template for assessing hidden or unconscious bias of a person. System user created “Decision Objects” are subject or topic areas for which a decision is to be made and preferably in the form of questions or statements to which the “Target,” who is the person or thing being evaluated, is to respond. System user created “Decision Dimensions” preferably are sub-questions relating to a Decision Object. These definitions of Profiles, Objects, a Dimensions will apply herein unless indicated to the contrary.
[0072] Before discussing the processes for bias assessment or decision-making, the method used to characterize Bias Dimensions and Decision Dimensions will be set forth because that is the basis for the generation of Bias Assessment and Confidence Index scores. Dimensions have two parts: (1) The “Question or Statement” created by the SME or system user to which a Target responds, and (2) the Importance Factor to which both the System User and Target assign a value. While the two parts are created using the same functionality, they serve dramatically different purposes. The Question or Statement frames the topic to which the Target provides answers, and the Importance Factor adds a second and complimentary data point by only focusing on the importance of the question or statement to the both the system user and target. The response values to the Question or Statement and Importance Factor are then combined as set forth to generate bias assessment or confidence index scores. The method for generating values from the Question or Statement responses will be described first with respect to
[0073] In carrying out scoring according to the present invention, the first action is the creation of a Profile question or statement, then the creation of questions or statements for the one or more Objects, then finally the creation of questions or statements for the one or more Dimensions for each Object. The actual scores are generated in the reverse direction. Preferably, the entity that creates the questions or statements with respect to Bias Assessment is a SME and with respect to decision-making is the system user or SME at the system user's behest.
[0074] As stated, the generation of scores begins with the Dimensions. The “target,” the person being evaluated for hidden or unconscious bias in the case of Bias Assessment or the party(ies) with whom the system user is engaged for decision-making, provides responses to the Dimension questions or statements that were sent to them in accordance with the system and method of the present invention. The Dimension scores are generated, and these scores are used to generate the Object scores, and in some cases, the Object scores are aggregated to generate a composite score for the Profile. The method of generating Dimension scores will now be disclosed.
[0075] Referring to
[0076] The boundaries of a full range, and of any child range, may have labels to define their limits, including shared labels the contiguous child ranges or the coincident ends of a child range and the full range. These labels are shown at 1418, 1420, 1422, 1424, and 1426. Further, each boundary limit may be expressed as a number or percentage. This is shown in
[0077] In order to set the limits of the Child Ranges, each child range limit is enabled by the presence of an adjustment ball or slider at the boundary limit shared by two contiguous child ranges. In
[0078] Each Child Range will have associated with it a score, text comment, and system instruction. Of these three, it is always necessary to have a score assigned to each child range. This score is needed for calculating a bias assessment and confidence scores. Score ranges may be custom, linear, logarithmic or exponential.
[0079] Each child range may be assigned a text comment. These are triggered to assist system users with textual information about the details of a respondent's responses. And each child range, if selected, may result in a system instruction being triggered to cause an automated action to be taken by the system. An example of which may be to change or add Decision and/or Bias profiles, make a call to appropriate authorities to report dangerous potentialities, or to flag a target's profile.
[0080] Again, referring to
[0081] At 1427 of
[0082] The system user may indicate along the full range a location that would be the ideal response it would prefer from a target. This is represented at 1430. The positioning of this location is made by slider 1431. And the number value or percentage of this ideal value is indicated at 1432. This is used for calculating the Confidence Index score.
[0083] To continue with an example of how Bias Assessment and Confidence Index scores are determined, the following is provided with respect to
[0084] Referring to
TABLE-US-00001 Reference No. Item Value 1402, 1404 Question, Full Range Do you mind that I have expensive cookware that I don't share 1452 # of Child Ranges 3 1454, 1456, Child Range #1, N/A 1458 Child Range #2, Child Range #3 1430, 1431, Ideal Response 85% 1432 1427 Acceptable Range 25%-100% 1416, 1428 Acceptable Range Lower 25% Limit Slider Position 1417, 1429 Acceptable Range Higher 100% Limit Slider Position 1418 Full Range Left Yes Hand Label 1426 Full Range Right Absolutely Not Hand Label 1416A, 1460 Child Range #1 0%-25% Boundary Limits 1460, 1462 Child Range #2 25%-40% Boundary Limits 1462, 1416E Child Range #3 40%-100% Boundary Limits 1464 Target Response 65% 1454A, 1454B, Child Range #1: Score: −1 1454C Score, Text Comment, Text Comment: Child System Instruction Range #1 Sys. Instr.: CANCEL MATCH 1456A, 1456B, Child Range #2: Score: 0 1456C Score, Text Comment, Text Comment: Will you System Instruction bring your own cookware? Sys. Instr.: N/A 1458A, 1458B, Child Range #3: Score: +1 1458C Score, Text Comment, Text Comment: How often System Instruction do you cook? Will you bring your own cookware? Sys. Instr.: N/A
[0085] The values and statements may be used to calculate, in this case, a Confidence Index score. However, it is be understood that this could also be used with different information populating the elements to be used for calculating a bias assessment score.
[0086] Referring to
TABLE-US-00002 Reference No. Item Value 1402, 1404 Question, Full Range How many days per year do you expect to have work-related people enter our home? 1472 # of Child Ranges 5 1474, 1476, Child Range #1, N/A 1478, 1480, Child Range #2, 1482 Child Range #3, Child Range #4, Child Range #5 1430, 1431, Ideal Response 4 1432 1496 Acceptable Range 0-52 1416, 1428 Acceptable Range Lower 0 Limit Slider Position 1417, 1429 Acceptable Range Higher 52 Limit Slider Position 1498, 1500, Full Range Labels 0-365 Never, Once a Year, Bi- 1502, 1504, Monthly, Monthly, 1506, 1508 Weekly, Everyday 1484, 1486 Child Range #1 0-1 Boundary Limits 1486, 1488 Child Range #2 1-6 Boundary Limits 1488, 1490 Child Range #3 6-12 Boundary Limits 1490, 1492 Child Range #4 12-52 Boundary Limits 1492, 1494 Child Range #5 52-365 Boundary Limits 1464 Target Response 20 1510A, 1510B, Child Range #1: Score: 125 1510C, Score, Text Comment, Text Comment: N/A System Instruction Sys. Instr.: N/A 1512A, 1512B, Child Range #2: Score: 60 1512C Score, Text Comment, Text Comment: Make System Instruction sure to get more information Sys. Instr.: Q: Am I expected to clean and/or vacate premises? 1514A, 1514B, Child Range #3: Score: 20 1514C Score, Text Comment, Text Comment: Set System Instruction expectations Sys. Instr.: Q: Will you be hiring a cleaning service before they come? 1516A, 1516B, Child Range #4: Score: −10 1516C Score, Text Comment, Text Comment: Demand System Instruction services Sys. Instr.: Q: In addition to a cleaning service, what is your company willing to pay for the intrusion? 1518A, 1518B, Child Range #3: Score: −1000 1518C Score, Text Comment, Text Comment: System Instruction Unacceptable Sys. Instr.: CANCEL MATCH
[0087] As discussed previously, there are two elements for generating both bias assessment and confidence index scores. The two elements are the values generated relating to the responses to the Questions or statements, and the values generated relating to the responses to the importance factor. Having described the method for generating the values for the responses to the Questions or Statements, the method for generating the values for the Importance Factor will now be described referring to
[0088] Referring to
[0089] With respect to
[0090] The boundaries of the full range and the child range may have labels to define what the limit will be for the two contiguous child ranges or the coincident ends of a child range and the full range. These labels are shown at 1578, 1580, 1582, 1584, and 1586. Further, each boundary limit must be expressed as a percentage. In this Figure, the percentages are shown at 1576A, 1576B, 1576C, 1576D, and 1576E. These percentages will apply to both the Child Ranges and the full range. Each limit for a child range or the full range may have a label in addition to a percentage. Percentages must be 0% to 100% for the full range.
[0091] The Importance factor, like the Questions or Statements, has acceptable range 1587 with sliders 1590 and 1591, and upper and lower percentage ranges at 1588 and 1589, respectively. Further, the Importance Factor has an ideal target that is shown at 1592 and its percentage value is shown at 1594. The location of the system user's ideal target is controlled by slider 1593. The system user's location of the ideal target is used for generating the Importance Factor value based on the difference between the system user's importance factor value and that of the target.
[0092] In order to set the Child Ranges, it is enabled by the presence of an adjustment ball or slider at the boundary limit shared by two contiguous child ranges. In
[0093] Each Child Range may have associated with it a text comment and system instruction. A text comment is triggered to assist system users with textual information about the details of a respondent's responses. And each child range, if selected, may result in a system instruction being triggered to cause an automated action to be taken by the system. Again, referring to
[0094] To continue with an example of how Bias Assessment and Confidence Index scores are determined, a description of what is shown in
[0095] Referring to
[0096] In
[0097] Each of the Object Scores are multiplied by Object Balance Factor 1533 and Object Importance Factor 1534 two generate the Balance Object Score 1535. Namely, Object Score 1530 is derived from the product of 8.18×14×75% to generate a Balanced Object Score of 85.9; Object Score 1531 is derived from the product of 23.0×5×35% to generate a Balance Object Score of 40.3; and Object Score 1532 is derived from the product of 0.44×150×100% to generate a Balance Object score of 66. Then, these Balance Object Scores are summed to generate the Decision Profile Score 1536 which is shown as 192. To the extent there were more objects with respect to Decision profile 1521, “Roommate Search,” there will be additional dimension scores and object scores calculated to generate the Decision Profile score. This process will be described in greater detail subsequently.
[0098] Once Decision Profile Score 1536 is determined, it is used with the system user's ideal score to generate the Confidence Index Score. The method for generating the Confidence Index score with respect to the Decision Profile 1521 with Decision Object 1522 is shown at 1539. The absolute value between the Decision Profile Score and Ideal Target Score 1537 is subtracted from the Ideal Target Score. The resultant score is divided by the Ideal Target Score to generate the Confidence Index Score 1538.
[0099] As mentioned previously, two types of scoring have been disclosed according to the present invention. The scoring is applicable to the determination of the Confidence Index Score generated in
[0100] The second type of scoring is referred to as “Custom Scoring.” The system user or a SME assigns custom scores to each Child Range to match their own specific needs. For example, consider that the system user has created an Object comprised of five Decision Dimensions. Since the scores may not be consistent from Dimension to Dimension, as they would be using percentage scoring, there is a need for a Balancing Factor for the scores of each Decision Dimension within a Decision Object, and for each Decision Object within a Decision Profile. In an example of a Decision Object with five Decision Dimensions, one Decision Dimension with a potential high score of 200 points must be balanced or normalized with another Decision Dimension that has a total score potential of 500 points by employing a Dimension Balancing Factor.
[0101] Decision Objects that use custom scoring also make use of an Object Balancing Factor. For example, if there are two equally important Decision Objects that have potentials of 200 points and 10 points, respectively. They also will need to be normalized.
[0102] Each Decision Object will also have an Object Importance Score that is indicated by the system user to be multiplied with the first Object Score to generate a Balanced Object Scores. The Sum of the Balanced Object Scores for a Decision Profile is the Profile Score.
[0103] Balancing Factors can be established through a manual or an automated regression process. Automated regressions have been widely applied and published on. And they are widely accepted mathematical and/or statistical normalization procedures and processes. As such, a person of ordinary skill in the art would understand how to use automated regressions. A visual score balancing tool, which graphically depicts the range of potential scores from either the Dimensions within an Object or the Objects within a Profile, it is part of the present invention. The Score Balancing tool will also permit a system user to manually apply an Object Importance Score to each Object. The system user has the ability to either manual or automated balancing for each Object, and for Object in a Profile. The Score Balancing Tool will reduce potential for unintended consequences of unbalanced scoring.
[0104] Now that the method of scoring has been described that will be used for both bias assessment scoring and decision-making scoring, the method system of the present invention will now be described.
[0105] Referring to
[0106] After the Start step at 102, the system user will decide what he/she/it wants to do with the decisioning tool at this time. The “entity” making the selection may be (1) an individual in his/her individual capacity (he/she) or an individual as a member of an Organization or (2) an Organization itself. For purposes of convenience, the “entity” will be referred to as the “system user” unless it is required to be more clearly defined as an individual or an Organization.
[0107] At decision step 104, the system user will choose whether to engage bias assessment on decision-making. If bias assessment is the choice, the process proceeds to process step 106, which will proceed with bias assessment. If at decision step 104, the system user chooses to engage decision-making, the process will proceed to decision step 108. At decision step 108, the system user will select which decision type with which to proceed. If the system user desires to pursue a searching/match decision, he/she will proceed to process step 110. If the choice is a comparison decision, the system user will proceed to process step 112. And finally, if the choice is a binary (Yes/No) decision, the system user will proceed to process step 114.
[0108] Assuming that the system user desires to conduct a bias assessment and proceeds to step 106, this step moves the process to step 204 in
[0109] From step 204, the method progresses to decision step 206 where the system user must indicate whether he/she is an individual acting in their own capacity or an Organization. Taking first, where the system user is an individual acting in their own capacity, the method proceeds to step 208. At step 208, the system user will select the bias assessment type which he/she seeks to be tested to determine if he/she has hidden or unconscious bias with respect to the selected area. For example, the individual may seek to find if they have hidden or unconscious bias with respect to subject areas such as race, ethnicity, country of origin, gender, gender identity, types of food, areas of the country to live, transportation modes and vehicles, and education. This list is not exhaustive but is representative of subject areas that may be investigated for hidden or unconscious bias.
[0110] Once the subject area is selected, the system user will access a SME database that stores templates of questions for developing a Bias Profile for the system user. A SME who develops a template for a specific subject area is an expert in that field and knowledgeable of the current social norms associated with that subject area. SMEs are screened for their knowledge in the subject area to ensure each is a recognized expert. The method of onboarding a SME and the development of templates is set forth in
[0111]
[0112] At step 304, a qualified SME will create a Bias Assessment Profile template for identifying hidden or unconscious bias that an individual may use when being tested in bias subject areas of the SME's expertise. This template will include one or more Bias Objects as shown at 306 and each Bias Object may include one or more Bias Dimensions at 308. An example of a Bias Profile template that include a Bias Object and associated Bias Dimensions questions is shown in
[0113] Referring to
[0114] Taking first the Bias Dimension question at 406, the system user “John Smith” will be required to provide two responses. The first at 408 is in response to the posed question “Have you made snap decisions about women workers' work habits?” And, the second at 410 is the importance of the question to the system user. The responses of the system user with vertical slider 409 in 408 and vertical slider 411 in 410 will result in the two-part score at 412. This score will not be provided to the system user when initially answering the Bias Dimension questions but provided as part of the results. However, to explain these scores, the first indicates Profile Score for a specific Target and the second is the Confidence Index.
[0115] Referring to the second Bias Dimension question at 414, the system user responded with the positioning of vertical slider 417 in 416 and vertical slider 419 in 418, which reflects his/her feelings with regard to this Bias Dimension question. These responses will generate the scores at 420 once the responses are processed according to the present invention. Similarly, the system user's responses to the third Bias Dimension question at 422 in the positioning of vertical slider 425 in 424 and vertical slider 427 in 426 will generate the scores at 428 once the responses are processed according to the present invention.
[0116] Again, referring to
[0117] Referring to
[0118] With regard to the other two Bias Dimension questions at 414 and 422, a similar analysis with respect to the system user's responses in relation to the SME acceptable societal ranges can be made. In question parts 416 and 418 of Bias Dimension Question 414, both of the system user's responses, namely, placement of vertical slider 417 in 416 and vertical slider 419 in 418, are within the SME societal acceptable ranges 456 and 458, respectively. However, the positioning of these system user responses within these SME ranges will be evaluated for purposes of determining to what extent they may indicate hidden or unconscious gender bias.
[0119] With regard to the Bias Dimension question at 422, the system user's response to the first part with the placement of vertical slider 425 in 424 of the question is far outside the SME acceptable societal range 460. This may likely indicate strong hidden or unconscious gender bias around this Bias Dimension question. The system user's response to the second part of last question 422 by the placement of vertical slider 427 in 426 is within the SME acceptable societal range but it will be analyzed to determine if it provides any indication of hidden or unconscious bias with regard to the importance of this question.
[0120] Referring to each of the Bias Dimension questions shown in
[0121] Again, referring to
[0122] Once a SME-created Bias Profile is developed at step 304 in
[0123] It would be understood by a person of ordinary skill in the art that a SME may be separately engaged to develop custom Bias Profile templates for use with the present invention. These custom templates may be provided to the system and method of the present invention for single or multiple use by system user or Organization having them developed. These custom Bias Profile templates will be fully compatible for use in the present invention for identifying hidden or unconscious bias.
[0124] Again, referring to
[0125] In the first step of the two-stage process, from step 218, begins at step 220 where the Organization will select the bias assessment type for the members of the Organization who are to be tested. By way of example, if the Organization was seeking to conduct the identification of hidden or unconscious gender bias, it may select a SME Bias Assessment Profile like the one shown in
[0126] If at step 222 , the situation is not one in which the Organization is developing a custom Bias Assessment Profile, that Organization will access the SME database, and search for and select the appropriate bias profile template to use for testing, e.g., gender bias. Once this is done, the Organization at step 224 may edit the SME Bias Assessment Profile if it's needed to better identify hidden or unconscious bias in the selected subject area. When this is completed, the Bias Assessment Profile will include one or more Bias Objects and each Bias Object will include one or more Bias Dimension questions.
[0127] At step 226, the Organization will select certain of its members for the particular bias assessment testing commensurate with the Bias Assessment template that is either (1) directly from the SME database, (2) one from the SME database that has been edited by the Organization, or (3) a custom Bias Assessment Profile template. These members may be part of any group of the Organization. For example, the selected group could be members of the “C Suite,” a certain level of managers, forward facing members of the sales and marketing team, etc. or it could even be third-party vendors of the Organization. And, following this selection of the one or more members of the Organization being tested for hidden or unconscious bias, at step 228 the Organization will distribute the Bias Assessment Profile to the selected members. And this will end the first stage of this section of the method.
[0128] To track the distribution of the bias Assessment Profile templates and the receipt of the responses, the Organization, when distributing the Bias Assessment Profile, may notify the Organization member being tested of (1) the day and time it was sent to them, (2) the due date by which the responses need to be returned to the Organization, (3) when a reminder will be sent to the member, and (4) any penalty that may be imposed on the member if the responses are not returned by the due date. These four items are just examples and a person of ordinary skill in the art would understand more or less than this information may be provided to the Organization member and still be within the scope of the present invention.
[0129] The second stage begins at step 230 where the selected members of the Organization answer the Bias Dimension questions that are part of the Bias Assessment Profile and transmit these answers back to the Organization or a third-party hired by the Organization to process the responses in accordance with the present invention. The processing of each Bias Assessment profile template at step 232 will be the same as described with respect to
[0130] If there is a group of Organization members being tested for hidden or unconscious bias, there may be additional inputs from the Organization reflecting what it proposes the corporate response would be to the Bias Dimensions questions. More specifically, the Organization will position a vertical slider with respect to each Bias Dimension question part and these responses will be compared to the members response and its relationship to the SME acceptable societal range for that question part. Further, the results for each member being tested will be provided to the Organization along with an aggregation of (1) the members scores for each Bias Dimension question and (2) Bias Dimension scores for each Bias Object. And, finally, an overall composite score will be generated for the Bias Assessment Profile.
[0131] Before discussing the scoring mentioned immediately above, as stated, part of the Organization's review of the Bias Assessment Profile will include the Organization's belief where it would desire the member responses to be to the Bias Dimension questions. The representative placement of the vertical sliders by the Organization will be done without the Organization being privy to the SME acceptable societal ranges and without knowledge of the member answers. Given this, it may be found that the Organization itself has significant levels of hidden or unconscious bias with respect to a particular bias subject area.
[0132] Also, when the Bias Assessment Profile template is distributed to the members, the Organization's desired scoring through the placement of vertical sliders will not be visible to members being tested. Therefore, the only entity aware of the placement of the vertical sliders of the members taking the test, the Organization's placement of its vertical sliders, and the SME acceptable societal ranges will be the system of the present invention that will use these values in carrying out the method of the present invention to generate the Bias Assessment scores, and hidden or unconscious bias assessment analysis.
[0133] Referring to
[0134] Again, referring to
[0135] The previously described scoring method will be used for generating the bias assessment score. Accordingly, the previously described scoring method is incorporated here by reference.
[0136] Referring to
[0137] Again, referring to
[0138] In
[0139] In the area located at 508, there are two members in this outlying area. These member responses are far from the SME-generated acceptable societal range and target provided by the Organization. This may indicate hidden or unconscious bias at levels unacceptable for the Organization to keep these individuals employed there. As such, these individuals may be separated from the Organization because of the scores.
[0140] The members with scores in areas 510 and 512 are outside the SME-generated acceptable societal range 504, and away from the Organization's target value, which may indicate the necessity to provide them with specialized training to address their hidden or unconscious bias indicative of the scores that place them in these two areas.
[0141] Once the distribution curve is been generated for each of the Bias Dimensions associated with a particular Bias Object, a score is generated for the Bias Object based on the application of the Bias Dimensions. This will be described with reference to
[0142] Referring to
[0143] The first Bias Dimension distribution curve is shown at 606, the second Bias Dimension distribution curve is shown at 610, and the third Bias Dimension distribution curve is shown at 614. The three Bias Dimension distribution curves are normalized by the Organization's target value for the members associated with each distribution curve. By normalizing the three Bias Dimension distribution curves in this way, the Bias Object distribution curve representing all of the members' answers to the three Bias Dimension questions can effectively be shown by the aggregate Bias Object distribution curve 602. When the aggregate Bias Object distribution curve 602 is generated there, a SME acceptable societal range will also be created. This is generated by the SME based on his/her experience as an expert in the relevant subject area. A person of ordinary skill in the art would understand that the Bias Dimension distribution curves are only meant to be exemplary and combining these curves to generate the particular Bias Object distribution curve shown at 602 is also meant to be exemplary.
[0144] Next, to generate the composite score for the Bias Assessment Profile that has multiple Bias Objects, it will be necessary to combine the Bias Object distribution curves that have been generated from the Bias Dimensions responses as shown with respect to
[0145] Similar to the aggregation of the Bias Dimension distribution curves described with respect to
[0146] Referring to
[0147] As stated, the three normalized Bias Object distribution curves are combined in a manner substantially the same as the method used to combine the Bias Dimension distribution curves. The resulting distribution curve is shown in
[0148] Having now described the method by which the decisioning tool of the present invention generates numeric scores for objectively identifying the hidden or unconscious bias of an individual, whether acting in his/her own capacity or as a member of an Organization, and providing Organizations with methods to aggregate information regarding the hidden and unconscious biases of its members to generate Organization-wide numeric scoring to understand its global hidden and unconscious bias exposure, the other novel feature of the decisioning tool of the present invention directed to decision-making will now be disclosed.
[0149] Referring to
[0150] To understand the decision types indicated above, they each will be separately covered beginning with searching/match decisions followed by comparison decisions, and last binary (Yes/No) decisions.
[0151] Referring to
[0152] Once the system user defines the target subject area at step 904, he/she will progress to step 906 to define computer-based sourcing for potential targets. This will involve determining where the computer-based system can conduct searches to identify potential targets. Likely sources may be any of the top-tier Internet search engines such as Google, Bing, Yahoo, Contextual Web Search, to name a few. Also, the system user may have access to subscription-based services whose members may desire to have information about them in a searchable database for matches relating them, things they own, or services they provide.
[0153] Having identified sourcing for searching for potential targets, the system user will take that information and at step 910 develop then generate a searchable database for identifying potential targets. The information generated at steps 904 and 906 may optionally be provided by a SME at 908. The system user may do this if he/she desires the SME's assistance in developing the searchable database because of the SME's expertise in the target search area. This assistance may be in the form of the SME helping the system user with the development of the searchable database or it may be that the system user would engage the SME to create the searchable database for him/her.
[0154] In order for the system user to conduct a search of the searchable database developed by the system user alone, with the help of a SME, or developed solely by a SME for the system user, he/she must develop a Decision Profile, one or more Decision Objects, and one or more Decision Dimensions for each Decision Object. This is generally shown in
[0155] Referring to
[0156] In
[0157] Decision Dimension No. 1 at 1010 and Decision Dimension No. 2 at 1012 provide refinement to the Decision Object at 1004/1006. Decision Dimension No. 1 is “Will you frequently have people over to eat with you during the work week?” and Decision Dimension No. 2 is “Are you opposed to sharing large pots and pans for cooking?” are the requirements that will be scored along with the scoring of the importance of the Decision Object at 1004/1006. These and other Decision Object/Decision Dimension sets will be aggregated for each target under consideration to determine the best matching score for system user's matching requirements.
[0158] Referring to
[0159] Referring to Decision Dimension #2 shown at 1042, “Are you opposed to sharing large pots and pans for cooking?,” and using the same scoring method described with respect to Decision Dimension #1 relating to system user's preferred scores, in Inquiry scale 1044, the system user positioned slider 1046 at “15” indicating that system user did not mind sharing large pots and pans for cooking with the roommate. With regard to the Importance scale 1048, the system user positioned slider 1050 at “35” indicating that this of lower importance to the system user. Also, like what was described respect to the score at 1040 relating to Decision Dimension #1, the score at 1052 will be generated based on the match of a target's responses to those of the system user.
[0160] The positions that have been taken with respect to Decision Dimensions at 1028 and 1042 will be used in the previous described scoring method to generate a set of confidence index scores.
[0161] Referring to
[0162] In
[0163] As indicated above, the new rankings shown in 1064 are based on one or more supplemental questions being searched with respect to one or more of the targets identified in the search. This information may be gathered by online searching or the transmission of the supplemental questions to an entity capable of providing the responses on behalf of the target. At 1064, it shows a second set of Confidence Index scores and a new set of rankings among the top five targets identified during the search. At 1064, it also shows that there can be “N” sets of questions that can be searched or sent to one or more of the targets to generate a different set of scores. Further, as will be explained subsequently, the identified target to extent they receive information from the system user, they can transmit questions to the system user to answer which may also affect the ultimate score generated for matching between any identified target and the system user. These questions will be in a format similar to what the system user is using for the supplemental questions to the one or more targets. It is also understood by a person of ordinary skill in the art is possible to use other formats for the supplemental questions as long as it can provide a mechanism to determine the extent to which a match in the two responses can be determined for scoring.
[0164] The new ranking of the Top five targets will be considered by the system user as to whether or not he/she the wants to complete a match starting with the top scoring target. However, the system user may choose to provide additional supplemental questions to one or more of the targets to determine to what degree that will cause a change in the scores and thereby the rankings of the best match for the system user. And as previously stated, the system user may respond to a question provided by one or more of the targets which may also change the rankings with respect to the best match for the system user.
[0165] Again, referring to
[0166] When all of the supplemental questions have been asked and responded to, the process proceeds to 966 which indicates the process will be continued with
[0167] Having described the searching/match decision process, the comparison decision process will now be described. Referring to
[0168] Generally, when a system user is considering making comparison decisions using the process of the present invention, there are two comparison decision types from which to choose. The first is a “closed comparison” decision in which only a predetermined list of targets are permitted to complete the information requested by the system user. The second is an “open comparison” decision in which any number of third-party users of the system may complete the information requested by the system user, e.g., a generally open request for proposal (RFP).
[0169]
[0170] This target subject area may be directed to an entity (in the form of a person or company), a product (type of automobile to purchase), or a service (telephone services). A person of ordinary skill in the art would understand that there may be other target subject areas than the three that have been indicated above and it would still be within the scope of the present invention.
[0171] After the system user defines the target subject area at step 1134, the process moves to decision step 1136 where the system user will decide whether he wants to conduct a closed comparison decision or an open comparison decision. If the system user selects an open comparison decision, you will move to process step 1148 where there will be the transmission of information requests that will be open for responding from anyone authorized to be on the decision-making system. Alternatively, the transmission of the information requests may be open to others outside of the decision-making system, for example, it can be posted on industry electronic boards or other types of media available to large numbers of people or companies. An example of such posting locations would be any that could be used for posting request for proposals (RFPs) to attract people or companies in a specific subject area.
[0172] After the system user post information requests, preferably in a designated format, at the appropriate locations, which may be electronic or otherwise, at process step 1150, the system user will receive the requested information from 1-N targets in the preferred format. The information that is received will be stored in target information database 1146. At this point, the system user will move to 1152, which indicates the system user will proceed with further processing of the comparison decision method according to the present invention found at
[0173] Returning to decision step 1136, if the system user decides that he/she wants to conduct a closed comparison decision, the process will move to process step 1138. At this step, the system user will define the closed list of targets for which a comparison decision is sought. Once the target list for comparison is generated by the system user, the system user will transmit the information requests to these targets and, preferably, the information requests will be in a standardized format. Alternatively, at process step 1144, the system user may obtain through the Internet or other electronic searching means the needed information about the targets so that the comparison decision process can be performed. Electronic searches of this type may be done by the system user or by a third-party hired by the system user.
[0174] At process step 1142, the system user receives the requested information back from two or more targets. This information is stored in target information database 1146. Also, the information electronically obtained by the system user or his/her surrogate at process step 1144 is stored in target information database 1146. The accumulated information about the targets is transmitted to step 1152 which indicates the comparison decision process will be continued on
[0175] Referring to
[0176] Referring to
[0177]
[0178] Again, referring to
[0179] After the system user generates the Decision Profile, the 1-N Decision Objects, and the 1-N Decision Dimensions for each Decision Object as shown at 1164, 1166, and 1168, the process moves to process step 1170. At this step, the system user generates comparison scores for each of the targets that are part of the comparison decision.
[0180] As stated, the scores for Decision Dimension will be calculated at step 1170. The method for calculating these scores is according to the method that has been described. This scoring method is consistent with the scoring method used in the searching/match decision method.
[0181] After the scores are generated for the each of the targets, at process step 1172, the system user generates a grid, list, table, or other means that shows the highest to the lowest score for all of the targets that were compared. List that is generated may select maybe the top three or four further consideration. Once the list is generated, the system user will proceed to 1174 where it indicates the process will continue on
[0182]
[0183] If for some reason the system user does not want to select the Target with the highest Confidence Index score or desires to look at a new set of targets, the system user will proceed to decision step 1186. At this step, the system user may select any of the other targets that were evaluated in the comparison process regardless of their Confidence Index score. Preferably, if the system user makes one of the selections, the process will proceed to process step 1190 where the system user may optionally provide feedback to the system of why this alternative choice was made. After this the process proceeds to terminal step 1194 to end the process.
[0184] If the system user does not select any of the targets that were compared in the current set of targets, the system user will proceed to decision step 1188 where he/she will decide if it is desirable to restart the comparison decision process with a new set of targets. If the system user decides that is desired, the process will move to process step 1192 for restarting the comparison decision process. As such, the system user will be returned to the beginning of the process at step 1134 in
[0185] Having described the comparison decision processes present invention, the third type of decision process, the binary (Yes/No) decision process, will be described. The binary (Yes/No) decision process is a subset of the comparison decision process has been previously described. However, for clarity, the flow diagram for this third decision process of the present invention will now be set forth.
[0186] Referring to
[0187] After the two targets have been defined, it is now necessary to obtain information about the two targets. According to the present invention, there can be two methods to obtain this information. At process step 1308, the system user may send out information requests to the targets if such targets had the ability to appropriately respond. Further, it may be that the system user may send out such requests to only one of the two targets depending on who or what the targets are. The other method of obtaining information regarding the two targets is shown at process step 1310. At this step, the system user gathered information about one or both targets via electronic means, such as, researching information on for example the Internet. Again, this may apply to one or both targets.
[0188] If the system user has found it appropriate to send information requests to one or both targets, at step 1312, the system user will receive the requested information back from the one or both targets. The information that is received at process step 1312 and the information electronically gathered by the system user at process step 1310 are input to a target information database at 1314 to be accessible by the system user during the process. After the information is loaded into the target information database, as indicated at 1316, the process will continue at
[0189]
[0190] Further, as shown at 1326, there will be a SME review of the target subject area to ensure that it is a permissible subject area. As set forth respect to the comparison decision process, if it is impermissible it may result in ending the process.
[0191] Based on the responses to the Decision Dimensions a Confidence Index score for each target will be generated. This is set forth at process step 1332. The method of generating the Confidence Index scores for each of the targets is effected the same as the method described for the comparison decision process. Therefore, those descriptions are incorporated here by reference.
[0192] After the Confidence Index scores have been generated for each target, as shown at 1334, the remainder of the bias decision process is continued on
[0193] If the system user at decision block 1346 decides not to select the target with the lowest Confidence Index score, the system proceeds to decision block 1350 where the system user decides whether to end the process or restart the binary decision process. If the system user decides to no longer engage in the binary decision process, you she will proceed to terminal step 1354 and end the process. On the other hand, if the system user decides to restart the binary process with new targets the process will proceed to process block 1352 which will restart the process beginning at process step 1304 in
[0194] With respect to both the comparison decision process and binary decision process, there will be anonymity between the system user and the target to the extent that target is an entity such as a person, corporation, institution, etc. until such time as both parties agree to the match. It is only at this time that the two parties will have their identities disclosed to the other. This process is the same as described with respect to the searching/match decision process and therefore that disclosure is included here by reference.
[0195] The system and method of the present invention also provides a secure environment for the handling of information that is processed. Given the information being processed includes, but is not limited to, bias assessment information, personal data, medical data, information relating to minors, to name a few, it is necessary that access to, and processing of, information being held by the system be carefully controlled. In order to do this, the system of the present invention has a security multi-layer secure data shell that enables the protection of the sensitive information being handled by the system. As indicated in
[0196] Referring to
[0197] Looking more closely at the entities providing inputs, as seen in
[0198] The second entities providing inputs to secure data shell 1702 are SMEs at 1722. As shown at 1722, SMEs provide inputs such as templates that can be used for bias assessment and decision-making The SMEs also provide various types of inputs that assist system users and participants in bias assessment and decision-making as it relates to their area(s) of expertise.
[0199] The third entities providing inputs to secure data shell 1702 are participants at 1724. These entities provide inputs associated with both decision-making and bias assessment processes. This can be as invited participants in bias assessment or as a target in decision-making or SMEs. In carrying out their roles as participants, like system users, they can provide their preferences and priorities as part of their inputs and particularly as it impacts the requests, questions, and answers input to the multi-layered secure data shell.
[0200] The outputs at 1708 are results not raw data as shown at 1728. These results can be bias assessment scores, decision Confidence Index scores, and answers to questions that imposed in a course of decision-making or bias assessment. And, it is important that the only outputs from the multi-layered secure data shell 1702 that relate to any entity's private and sensitive data, other than results, have to be specifically authorized by the entity that owns that information.
[0201] Focusing now on multi-layered secure data shell 1702, it is noted that there will be Intel repositories for securely holding “My Data” 1714 and “Other User's Data” 1716 until it is needed for either decision-making or bias assessment. Also shown in decision and assessment loop 1710, certain decisions and assessments can be carried out with only system user data and does not require any additional data from others. However, as shown at 1712, the bulk of the transactions involving bias assessment and decision-making are carried out using the system user's data and the data of others. This is the usual situation given the decision-making process involves two opposing parties and some bias assessments require additional information from others to determine the accuracy, for example, bias assessments in a company setting.
[0202] In referring to
[0203] A representative of the computer-based server system of the present invention is shown at 1804. Preferably, the computer-based system shown at 1804 is a scalable server system capable of handling large numbers of transactions for effecting operation of the bias assessment and decision-making processes. The computer-based server system of the present invention that is represented by the unit shown at 1804 is part of business layer 1816.
[0204] The final major element of the system of the present invention is cloud-based non-colluding data storage shown at 1806. In order to ensure the security of the data being processed by the system of the present invention, the system data is stored in non-colluding cloud data storage. The operation of non-colluding cloud data storage would be understood by a person of ordinary skill in the art to provide an environment in which information is securely stored. The non-colluding cloud data storage is part of the data layer 1818.
[0205] As shown in
[0206] Noting the foregoing, the system of the present invention has been described along with its operation for carrying out bias assessments and decision-making. Moreover, the type of security being provided will enable sensitive information being processed by the system of the present invention to be safely handled.
[0207] The embodiments or portions thereof of the system and method of the present invention may be implemented in computer hardware, firmware, and/or computer programs executing on programmable computers or servers that each includes a processor and a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements). Any computer program may be implemented in a high-level procedural or object-oriented programming language to communicate within and outside of computer-based systems.
[0208] Any computer program may be stored on an article of manufacture, such as a storage medium (e.g., CD-ROM, hard disk, or magnetic diskette) or device (e.g., computer peripheral), that is readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the functions of the embodiments. The embodiments, or portions thereof, may also be implemented as a machine-readable storage medium, configured with a computer program, where, upon execution, instructions in the computer program cause a machine to operate to perform the functions of the embodiments described above.
[0209] The embodiments, or portions thereof, of the system and method of the present invention described above may be used in a variety of applications. Although the embodiments, or portions thereof, are not limited in this respect, the embodiments, or portions thereof, may be implemented with memory devices in microcontrollers, general purpose microprocessors, digital signal processors (DSPs), reduced instruction-set computing (RISC), and complex instruction-set computing (CISC), among other electronic components. Moreover, the embodiments, or portions thereof, described above may also be implemented using integrated circuit blocks referred to as main memory, cache memory, or other types of memory that store electronic instructions to be executed by a microprocessor or store data that may be used in arithmetic operations.
[0210] The descriptions are applicable in any computing or processing environment. The embodiments, or portions thereof, may be implemented in hardware, software, or a combination of the two. For example, the embodiments, or portions thereof, may be implemented using circuitry, such as one or more of programmable logic (e.g., an ASIC), logic gates, a processor, and a memory.
[0211] Various modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principals set forth below may be applied to other embodiments and applications. Thus, the present invention is not intended to be limited to the embodiments shown or described herein.