Telepathic typically is any integrated use of telecommunications and informatics, also known as Information and Communications Technology (CIT). Artificial Intelligence is defined by Webster as a branch of computer science dealing with the simulation of intelligent behavior in computers. It can also be defined as the capability of a machine to imitate intelligent human behavior. From that we can tell that any program that can strike up a conversation with a human (such as the artificial passenger) would be artificial intelligence.
The Artificial passenger was introduced by Dimity Sneaky and Welded Squadron of IBM labs. IBM got the patent for this in 2001. The artificial passenger is a type of artificial intelligence Field of invention The present invention relates to a system and method for determining three dimensional head pose, eye gaze direction, eye closure amount, blink detection and flexible feature detection on the human face using image analysis from multiple video sources.
Additionally, the invention relates to systems and methods that make decisions using passive video analysis of a human head and face. These methods can be used in areas of application such as human-performance measurement, operator monitoring and interactive multi-media. Background of the invention Early technique uses for determining head-pose used devices that were fixed to the head of the subject to be tracked. For example, reflective devices were attached to the subjects head and using a light source to illuminate the floaters, the reflector locations were determined.
As such reflective devices are more easily tracked than the head itself, the problem of tracking head- pose was simplified greatly. Virtual-reality headsets are another example of the subject wearing a device for the purpose of head-pose tracking. These devices typically rely on a directional antenna and radio-frequency sources, or directional magnetic measurement to determine head-pose. Wearing a device of any sort is clearly a disadvantage, as the user’s competence and acceptance to wearing the device then directly affects the reliability of the yester.
Devices are generally intrusive and will affect a user’s behavior, preventing natural motion or operation. Structured light techniques that projects patterns of light onto the face in order to determine head-pose are also known. The light patterns are structured to facilitate the recovery of AD information using simple image processing. However, the technique is prone to error in conditions of lighting variation and is therefore unsuitable for use under natural lighting conditions.
Summary of the Invention The present invention provides apparatus and techniques for providing an alarm indication to an owner or driver of a vehicle to indicate potentially hazardous or undesirable conditions. An advantage of the present invention is that it is configured to monitor the environment of a vehicle and provide an alarm indication to an owner or driver of the vehicle regardless of the location of the owner or driver. Additionally, the present invention is configured to have the ability to take preventative and/or corrective actions with respect to the potentially hazardous or undesirable situation.
Accordingly, in a first aspect of the present invention, a situation controller for a vehicle is provided. The situation controller includes a processing device and an image monitor coupled to the processing device, for monitoring images associated with one or more items within the vehicle. The situation controller also includes a device for communicating a message relating to the one or more monitored items wherein the content of the message is determined by the processing device based at least in part on the one or more monitored items.
Additionally, a controller coupled to the processing device, for controlling at least one function of the vehicle in response to the one or more monitored items within the vehicle, is included. In a second aspect of the present invention, a camera system is combined with an artificial passenger system (also referred to herein as a “vehicle system situation controller” or “situation controller”) to monitor an environment of a vehicle and provide an alarm indication to the owner.
The camera system identifies the position of keys, for example, and notifies the driver that he or she has left the keys in a particular spot in the vehicle. Thus, the present invention will warn the driver against accidentally locking the keys in the car. In accordance with a third aspect of the present invention, the artificial passenger is connected to a temperature indicator to analyze the temperature in the vehicle.
Thus, in combination with the camera, the artificial passenger is able to determine that a child or pet has been left in a vehicle that it is beginning to get very hot or cold. If the temperature gets too hot or too cool inside the vehicle, the artificial passenger has several options including sending a message to the owner/driver, calling the owner’s phone or beeper, calling the police, opening a window or a door, and sounding an alarm to get the attention of people walking by the vehicle (as well as allowing hem to open the door to help the occupant).
The artificial passenger is able to analyze the situation and execute a corrective action, which includes opening a window or a door to allow the temperature to moderate or to allow the child or pet to leave the vehicle, after the artificial passenger has notified the driver or authorities. In a fourth aspect of the present invention, the artificial passenger is configured to analyze the situation to determine, for example, whether groceries were left in the vehicle. If the owner did not remove all of the groceries, the artificial passenger will call the owner and tell him or her that he groceries were left in the vehicle.
The artificial passenger utilizes an odor detector or sensor as well as the camera to detect whether groceries were left in the vehicle. In accordance with a fifth aspect of the invention, a communication system that interacts with the owner of the vehicle from a remote location is provided. The communication system utilizes, for example, the Internet and/ or a global positioning system (GAPS) to locate and communicate with the vehicle owner. Through the communication system, the owner can, for example, open a vehicle door remotely such that a person can enter the locked vehicle.
These and other objects, features and advantages of the present invention will become apparent from the following detailed description of illustrative embodiments, which is to be read in connection with the accompanying drawings. Examples of systems that use this style of technique examples of systems that use this style of technique can be seen in ‘A Robust Model-Based Approach for AD Head Tracking in Video Sequences” by Marcus Malice and Francoise Pretext, and “Robust AD Head Tracking Under Partial Occlusion” by Ye Ghana and Chancre Jackhammers, both from Conference of Automatic and Gesture Recognition 2000, Greenbelt France. OVERVIEW The AP is an artificial intelligence-based companion that will be resident in software and chips embedded in the automobile dashboard. The heart of the system is a conversation planner that holds a profile of you, including details of your interests and profession. When activated, the AP uses the profile to cook up provocative questions such “Who was your first teacher? ‘ via a speech generator and in-car speakers. A microphone picks up your answer and breaks it down into separate words with speech-recognition software.
A camera built into the dashboard also tracks your lip movements to improve he accuracy of the speech recognition. A voice analyzer then looks for signs of tiredness by checking to see if the answer matches your profile. Slow responses and a lack of intonation are signs of fatigue. If you reply quickly and clearly, the system judges you to be alert and tells the conversation planner to continue the line of questioning. If your response is slow or doesn’t make sense, the voice analyzer assumes you are dropping off and acts to get your attention.
The system, according to its inventors, does not go through a suite of rote questions demanding rote answers. Rather, it knows our tastes and will even, if you wish, make certain you never miss Paul Harvey again. This is from the patent application: “An even further object of the present invention is to provide a natural dialog car system that understands content of tapes, books, and radio programs and extracts and reproduces appropriate phrases from those materials while it is talking with a driver. For example, a system can find out if someone is singing on a channel of a radio station. The system will state, “And now you will hear a wonderful song! ” or detect that there is news and state, “hear the following and play some news. The system also includes a recognition system to detect who is speaking over the radio and alert the driver if the person speaking is one the driver wishes to hear. ” Just because you can express the rules of grammar in software doesn’t mean a driver is going to use them.
The AP is ready for that possibility: It provides for a natural dialog car system directed to human factor engineering for example, people using different strategies to talk (for instance, short vs.. Elaborate responses). In this manner, the individual is guided to talk in a certain Way so as to make the system work-?e. G. , “Sorry, I dint get it. Could you say it briefly? ” Here, the system defines a narrow topic of the user reply (answer or question) via an association of classes of relevant words via decision trees. The system builds a reply sentence asking what are most probable word sequences that could follow the users reply. 08-03-2011, 02:43 PM Post: PRESENTED BY CHITCHAT L posting Freak  Introduction ; Driver fatigue according to NATHAN annually causes 1 crashes 1 ,ADD fatalities 71 ,OHO injuries Majority of the road accidents were preceded by eye closures of 0. 5 second as long as 2 to 3 seconds A normal human blink last 0. To 0. 3 seconds Existing System Miniature system installed in driver’s hat. Use of simulation drinks (egg: coffee &tea). Tablets to prevent sleeping In order to overcome the disadvantages of existing method IBM introduces a new sleep prevention technology device.
ARTIFICIAL PASSENGER Developed By IBM (International Business Machines Corporation, NY) has developed a software that holds the conversation with driver to determine whether the driver can respond alertly enough, called “Artificial Passenger”. Designed to make solo journey safer and more bearable. Showing the dashboard of the car where the whole AP system is attached About Artificial Passenger The AP is an Artificial Intelligence based companion that will be resident in software and chips embedded in the automobile dashboard. Conversational planner: holds a profile of the driver, including details of his interests and profession.
A microphone picks up driver’s answer and breaks it down into separate words with speech-recognition software. A camera built into the dashboard, tracks drivers head and lip movements to improve the accuracy of speech recognition. A voice analyzer then looks for signs of tiredness by checking to see if the answer matches your profile. Slow responses and lack of attention are signs of fatigue. There is a mobile indicator device, with the help Of which the driver can answer the call using touch sensitive wheel. The touch sensitive wheels have sensors on it.
It helps the driver to control the devices of the car without interrupting the dialog between dashboard and the driver. Components The components which supports the working of the system: Automatic speech recognizer (CARS) Natural language processor (NIL) Driver analyzer Conversational planner Alarm, Microphone Camera and Eye tracker Automatic speech recognition Allows the computer to identify the words spoken on to a microphone. Two Cars used: Speaker independent CARS – used for decoding voice signals of the driver. Operates with voice car media and decodes tapes, audio book, telephone mails etc.
Natural language processor NIL Processing is a combination of CSS and linguistics. Major functions of NIL are: Co – reference resolution Machine translation Natural language generation Natural language understanding Processes decoded signals of textual data provided from CARS. Identifies related meanings from the contents of the decoded messages. Produces variant of responses. This output goes to the driver analyzer as an input. Receives the textual data and voice data from NIL. Measures the time response using a clock. Depending on the time responses, conclusions about driver’s alertness will be given to the conversational planner.
Steps for detecting driver vigilance It is the heart of the system. Instructs the language generator to produce the response. If the driver is in perfect condition COP instructs the language generator to continue the conversation otherwise it is instructed to change the converse Zion. For each question, it creates a set of possible answers. Alarm If the COP (conversational planner) receives information that the driver is about to fall asleep, an alarm (buzzer) system is activated. Microphone For picking up the words and separate them by some internally used soft. Are for conversation. Camera ; Analyze video sequences of the driver to determine whether the driver is paying adequate attention to the road. ; Track the head and lip movements of the driver. Used for the improvement of accuracy of the speech recognition system. Calculations vary for day and night conditions Night time is determined based on the following conditions: If camera clock is between 18. 0 hrs and 07. 00 hrs If the intensity of image is lower than the threshold value If the night time driving headlight is on Eye Tracker Eye-tracking software is used for this purpose.
The camera will track the eyes. System measures the corneal reflection of an infrared light emitting diode (LED), which illuminates and generates a reflection of the surface of the eye. Glint is used for calibration and tracking. Working of eye tracker Working Conversational planner initiates the conversation Camera tracks the head and lip movements and also eye movements and detect whether the driver is alert or not. It detects the frequency of yawning f the driver and generates an alarm signal if the above frequencies exceeds a selected threshold value.