WO2011058224A1 - A mobile device controlled by context awareness - Google Patents
A mobile device controlled by context awareness Download PDFInfo
- Publication number
- WO2011058224A1 WO2011058224A1 PCT/FI2010/050901 FI2010050901W WO2011058224A1 WO 2011058224 A1 WO2011058224 A1 WO 2011058224A1 FI 2010050901 W FI2010050901 W FI 2010050901W WO 2011058224 A1 WO2011058224 A1 WO 2011058224A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- context
- vector
- mobile device
- feature values
- change
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/50—Service provisioning or reconfiguring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Definitions
- the invention relates generally to mobile devices. More particularly, the invention relates to a method for controlling a mobile device on the basis of context awareness and to a mobile device arranged to be controlled by context awareness. Furthermore, the invention relates to a computer program for controlling a mobile device on the basis of context awareness.
- a mobile phone such as for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, and a wrist-top device
- PDA personal digital assistant
- sensors that may be configured to provide real-time sensing data on the surrounding environment and/or the user of the mobile device.
- the current context i.e. the state of the physical environment, the state of the mobile device itself, and/or the physiological state of the user, for example.
- the information about the context and changes in the context can be utilized in implementing context-aware applications such as for example context-sensitive user interfaces of mobile devices.
- context-aware applications such as for example context-sensitive user interfaces of mobile devices.
- the challenges in implementing the context-aware applications are two-fold.
- Publication FI20095570 discloses an adaptive context recognition algorithm which may be initially trained by e.g. supervised adaptation process on the basis of available sensing data vs. indicated context information.
- the information needed for the supervised adaptation process may be, for example, data collected from a plurality of different users and it may thus provide a generally applicable initial state of the algorithm.
- the algorithm may work reasonably well on average. Thereafter, on-line/run-time adaptation may take place upon receiving feedback by the user of the mobile device.
- the second challenge in implementing the context- aware applications relates to using the information provided by the context recognition for controlling the mobile device in such a manner that the service actions taken as a response to a recognized change of context correspond sufficiently well to the needs of the user.
- the service actions are related to services provided with the mobile device and they can be, for example, adaptation of the user interface of the mobile device, adaptation of an application, adaptation of a menu, adaptation of a profile, adaptation of a mode, trigger an application, and/or close an application.
- Publication US2002167488 discloses a mobile device that includes at least one sensor, such as a tilt sensor implemented by an accelerometer, which provides contextual information, e.g. whether the mobile device is being held or not.
- the device When the mobile device receives an incoming message, or notification, the device responds thereto based at least in part upon the contextual information.
- the control of the mobile device may work reasonably well on average when a sufficiently big group of users is under inspection but, in conjunction with a single user, the operation may, in some situations, be unsatisfactory.
- the mobile device comprises a processing system arranged to: recognize a change of context related to the mobile device and/or a user of the mobile device, - gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to recognizing a change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action.
- the selection of the service action is based at least partly on the usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context
- the selection can be personalized to correspond to earlier behavior of the user of the mobile device.
- the recognized change of context is an arrival at a place on which the user has typically loaded a certain web-page
- the corresponding piece of the usage data may be arranged to indicate that the service action to be selected as a response to the above-mentioned change of context is downloading the above-mentioned web- page.
- the above-mentioned place can be e.g. a bus-stop in the vicinity of the us- er's home and the above-mentioned web-page can be e.g. a time schedule of a bus operator.
- the above-mentioned change of context can be recognized e.g. on the basis of a positioning signal provided by a GPS-receiver (Global Positioning System) contained by or connected to the mobile device.
- a new me- thod for controlling a mobile device on the basis of context awareness comprises: recognizing a change of context related to the mobile device and/or a user of the mobile device, gathering usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to recognizing a change of context, selecting at least one service action at least partly on the basis of the usage data, the at least one service action being selected from among a pre-determined set of ser- vice actions related to services provided with the mobile device, and controlling the mobile device to perform the selected at least one service action.
- a new computer program for controlling a mobile device on the basis of context awareness comprises instructions executable by a programmable processor for controlling the programmable processor to: recognize a change of context related to the mobile device and/or a user of the mobile device, gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to recognizing a change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and - control the mobile device to perform the selected at least one service action.
- a computer program product according to the invention comprises a computer readable medium, e.g. a compact disc (CD) or a random access memory (RAM), encoded with a computer program according to the invention.
- a computer readable medium e.g. a compact disc (CD) or a random access memory (RAM)
- CD compact disc
- RAM random access memory
- figure 1 shows a flow chart of a method according to an embodiment of the inven- tion for controlling a mobile device on the basis of context awareness
- figure 2 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness
- figure 3 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness
- figure 4 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness
- figure 5 shows a flow chart of a recognizing method for recognizing a change of context, the recognizing method being usable in a method according to an embo- diment of the invention for controlling a mobile device on the basis of context awareness
- figure 6 shows a flow chart of a recognizing method for recognizing a change of context, the recognizing method being usable in a method according to an embodiment of the
- Figure 1 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness.
- the mobile device can be, for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, or a wrist-top device.
- the mobile device may include integrated and/or at least functionally, i.e. wirelessly or in a wired manner, connected sensing entities such as various sensors providing the necessary measurement, or "raw", sensing data for context recognition.
- the sensing entities may contain specific hardware, such as sensors sensing some physical quantity, and/or specific software to acquire the predetermined sensing data.
- sensing entities may be substantially software-based such as entities acquiring data related to the data stored in the mobile device such as calendar data or device (sw) status data.
- the sensing entities may include one or more sensors such as accelerome- ters, temperature sensors, location sensors such as a GPS (Global Positioning System) receiver, pulse/heart rate sensors, and/or photometers.
- a change in the current context is deduced, i.e. a change in the state of the physical environment, in the state of the mobile device itself, and/or in the physiological state of the user, for example.
- the method comprises recognizing, in a phase 101 , a change of context related to the mobile device and/or a user of the mobile device.
- the recognition of the change of context can be based on any suitable context recognition algorithm, and some examples will be given later in this document.
- the recognized change of context may be, for example, an arrival at a place having certain coordinates and it may happen that, after arriving at that place, a user of the mobile device makes the mobile device to download a certain web-page.
- the aforesaid place can be e.g. a bus-stop and the aforesaid web-page may be e.g. a time schedule of a bus operator.
- the above-mentioned exemplifying change of context: "the arrival at the aforesaid place” and the exemplifying control action given by the user: "making the mobile device to download the web-page” constitute an exemplifying item of usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context.
- a change of context has been recognized in the phase 101 , it is preferably monitored whether the user of the mobile device gives any control actions directed to the mobile device and, in a case the user gives a control action, a new item of the usage data is gathered in a phase 102.
- the length of a time interval after the change of context and during which it is monitored whether the user of the mobile device gives any control actions can be used as a settable parameter of the gathering functionality. It is also possible to record the time difference between the change of context and the subsequent control operation, this time difference being indicative of strength of correlation between the change of context and the subsequent control operation.
- the following actions are carried out in parallel with the gathering the usage data: - selecting, in a phase 103, at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and controlling, in a phase 104, the mobile device to perform the selected at least one service action.
- the selected service action may be, for example, downloading a certain web- page, e.g. the time schedule of the bus operator, as a response to a situation in which the change of context is an arrival at the place having certain coordinates, e.g. a bus-stop, and the usage data contains a data item indicative of correlation between this change of context and this service action.
- the data item of the usage data may have been gathered, the phase 102, when the user has previously ar- rived at the aforesaid place.
- the above-mentioned change of context can be recognized e.g. on the basis of a positioning signal provided by a G PS-receiver contained by or connected to the mobile device.
- the selection of the service action can be personalized to correspond to the earlier behavior of the user.
- the service action can be, for example, one of the following: adaptation of the user interface of the mobile device, adaptation of an application, adaptation of a menu, adaptation of a profile, adaptation of a mode, trigger an application, close an application, bring forth an application, bring forth a view, minimize a view, activate or terminate a keypad lock, establish a connection, terminate a connection, transmit data, send a message, trigger audio output such as playing a sound, activate tactile feedback such as vibration, activate the display, input data to an application, download a web-page, download a file, upload a file, shut down the mobile device.
- adaptation of the user interface of the mobile device adaptation of an application, adaptation of a menu, adaptation of a profile, adaptation of a mode
- trigger an application close an application, bring forth an application, bring forth a view, minimize a view, activate or terminate a keypad lock, establish a connection, terminate a connection, transmit data, send a message, trigger audio output such as playing a sound, activate tactile feedback such as vibration, activate the display,
- Figure 2 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness.
- Phases 201 , 202 and 204 are similar to the phases 101 , 102 and 104 of the method illustrated in figure 1 .
- the at least one service action is selected in a phase 203 using, in addition to the usage data, history data indicative of control actions given by users of other mobile devices during different changes of context related to the other mobile devices and/or the users of the oth- er mobile devices.
- the history data can be downloaded to the mobile device from an external device and/or received via a mobile communication network.
- the history data is especially useful when amount of the usage data gathered in the phase 202 is still low, i.e.
- FIG. 3 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness.
- Phases 301 , 302 and 304 are similar to the phases 101 , 102 and 104 of the method illustrated in figure 1 .
- the method shown in figure 3 comprises analyzing, in a phase 303a, correlations between different changes of context and different service ac- tions from a data base comprising the usage data and possibly also the history data.
- a phase 303 comprises selecting a service action that has greatest correla- tion with the recognized change of context.
- the correlations may be analyzed for example with a standard frequency analysis or with sophisticated data mining algorithms.
- Figure 4 shows a flow chart of a method according to an embodiment of the inven- tion for controlling a mobile device on the basis of context awareness.
- Phases 401 , 402, 403 and 404 are similar to the phases 301 , 302, 303 and 304 of the method illustrated in figure 3.
- the method shown in figure 4 comprises transmitting, in a phase 402a, a gathered usage data item to a server device via a mobile communication network and receiving, in a phase 402b, data indicative of correlations between various possible changes of context and various possible selectable service actions. Therefore, the analysis of the usage data and possibly also of the history data is carried out in the server device instead of the mobile device.
- the mobile device is not self-contained as to the method illustrated in figure 4, but the computational, memory, and battery resources of the mobile device can be spared instead.
- Figure 5 shows a flow chart of a recognizing method for recognizing a change of context.
- the recognizing method is usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness.
- the recognizing method shown in figure 5 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4. It is also possible to use the recognizing method illustrated in figure 5 in conjunction with other applications wherein the context and/or the change of context needs to be recognized.
- the recognizing of the change of context comprises: obtaining, in a phase 501 , sensing data from sensing entities such as, for example, accelerometers, temperature sensors, location sensors, pulse/heart rate sensors, photometers, entities for acquiring data related to the data stored in the mobile device, and/or entities for acquiring device status data, determining, in a phase 502, a vector of feature values on the basis of the sensing data provided by the sensing entities, and classifying, in a phase 503, the vector of feature values to one of predefined alternative context classes.
- sensing entities such as, for example, accelerometers, temperature sensors, location sensors, pulse/heart rate sensors, photometers
- entities for acquiring data related to the data stored in the mobile device and/or entities for acquiring device status data
- determining, in a phase 502 a vector of feature values on the basis of the sensing data provided by the sensing entities
- classifying in a phase 503 the vector of feature values to one of predefined alternative context classes.
- the change of context is present, a result phase 508, when the context class determined by the classification of the vector of feature values differs from a pre- viously determined context class; a decision phase 507.
- the previously determined context class is the context class recognized after the previous change of context.
- SFS Sequential Forward Selection
- the basic principle in the SFS- algorithm is to add a feature that increases the classification accuracy most to the current pool of features at each step. Hence, the SFS-algorithm performs optimization in the feature space.
- Sequential Backward Selection SBS
- SFFS Sequential Floating Forward Selection
- the procedure includes two parts. A new feature for the subset is added by the SFS-method. The worst feature is then conditionally excluded until no improvement is made to the previous sets.
- This method avoids the nesting effect of the SFS-method, in which the discarded features cannot be selected any- more.
- the inclusion and exclusion of a feature is deduced using a criterion value. It can be e.g. a distance measure or a classification result.
- a new feature which gives the best criterion with the previously selected features, is added to the feature subset according to the SFS- method.
- a conditional exclusion is applied to the new feature set, from which the least significant feature is determined. If the least significant feature is the last one added, the algorithm goes back to selecting a new feature by the SFS-method. Otherwise the least significant feature is excluded and moved back to the set of available features and conditional exclusion is continued. Again, the least significant feature is determined and the criterion without this feature is compared to the criterion with the same number of features in the memory. If the criterion is improved, the feature is excluded and moved back to the set of available features and this step is repeated until no further improvement is made. The cycle starts all over again by adding a new feature until the previously defined subset size is reached.
- Table 1 presents an exemplifying set of features which can be used for distinguishing the following exemplifying activities from each others: outdoor bicycling, soccer playing, lying, nordic walking, rowing with the rowing machine, running, sitting, standing, and walking.
- the sensing entities are acceleration sensors attached to the wrist and hip of the user.
- Table 1 An exemplifying set of features for classification.
- the classification in the phase 503 can be, for example, the minimum-distance classification that represents a rather straightforward way to accomplish the classification of the vector of feature values.
- the basic principle of the minimum- distance classification is to calculate distances from the vector of feature values to be classified to ideal feature vectors each of which representing a respective con- text class in the best possible way, and then to select the context class to the ideal feature vector of which the distance is smallest.
- the distances can be defined in the sense of a suitable vector norm, e.g. the 2-norm. If the feature values are represented in an N-dimensional vector space then there will be N-1 dimensional hyperplane separating each context class. In such case, e.g. a mean value of rep- resentative vectors of feature values belonging to a certain context class can be used as the ideal feature vector of that context class.
- the algorithm used in the classification can be adapted to correspond better to the specific needs of the user on the basis of the vector of feature values to be classified and feedback information given by the user.
- the feedback can be direct feed- back which explicitly indicates the desired context class for certain sensing data and for the corresponding vector of feature values.
- the user may therefore, through the direct feedback, assist and cultivate the classification algorithm when the user sees it appropriate.
- the classification may utilize the data and/or the corresponding feature values for adapting the classification algorithm.
- the algorithm used in the classification can be adapted on the basis of indirect feedback given by the user.
- the indirect feedback is feedback which is obtained after the classification action as indication of the quality and correctness of the automatically performed classification.
- the indirect feedback may indicate, for example one of the following alternatives: the user is highly satisfied with the outcome of the classification, the user is satisfied with the outcome of the classification, the user is dissatisfied with the outcome of the classification, and the user is highly dissatisfied with the outcome of the classification.
- the adaptation phase 506 may comprise moving the ideal feature vector of the context class determined by the classification or by the direct feedback closer to or farther away from the vector of feature values to be classified, the direction of the movement depending on the feedback information.
- a more detailed description of the adaptation of the minimum-distance classification algorithm can be found e.g. in FI20095570.
- Figure 6 shows a flow chart of a recognizing method for recognizing a change of context.
- the recognizing method is usable in a method according to an embodi- ment of the invention for controlling a mobile device on the basis of context awareness.
- the recognizing method shown in figure 6 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4.
- the recognizing method illustrated in figure 6 is a further development of the recognizing method illustrated in figure 5.
- a server device is asked to assist in the classification if data transfer connections to and from the server device are available and if the classification task might be too complicated for being performed by the mobile device in a reasonable time with a sufficient quality.
- the recognizing of the change of context comprises: obtaining, in a phase 601 , sensing data from the sensing entities, determining, in a phase 602, a vector of feature values on the basis of the sensing data provided by the sensing entities, checking, in a phase 603, whether classification of the vector of fea- ture values would fulfill a pre-determined quality criterion and whether the data transfer connections to and from the server device are available, as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmitting in a phase 604 the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of pre-defined alternative context classes, classifying, in an optional but non-necessary phase 605, the vector of feature values to
- the classification result i.e. a determined context class
- the server device is preferably used for determining whether or not a change of context has occurred.
- this context class given by the user is preferably used for determining whether or not the change of context has occurred.
- the phases 609, 610, and 61 1 of the recognizing method illustrated in figure 6 can be similar to the corresponding phases 506, 507, and 508 of the recognizing method illustrated in figure 5, respectively.
- the phase 603 comprises calculating the minimum of distances between the vector of feature values and the ideal feature vector of the alternative context classes in order to check whether the classification of the vector of feature values would fulfill the pre-determined quality criterion.
- the quality criterion can be, for example, such that the minimum of the distances should be below a pre-determined limit value.
- the distances can be defined in the sense of a suitable vector norm, e.g. the 2-norm.
- the phase 604 further comprises transmitting to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative context classes in a same manner as the classification is carried out in the mobile device.
- the applicability of the recognizing method illustrated in figure 6 is not limited to the methods illustrated in figures 1 -4, but the recognizing method illustrated in figure 6 can be used in various situations where the context and/or the change of context needs to be recognized.
- a device e.g. a processing system, arranged execute the recognizing method illustrated in figure 6 and also for a computer program comprising computer executable instructions for controlling a programmable processor to execute the recognizing method illustrated in figure 6.
- Figure 7 shows a flow chart of a recognizing method for recognizing a change of context.
- the recognizing method is usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness.
- the recognizing method shown in figure 7 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4.
- the recognizing method illustrated in figure 7 is a further development of the recogniz- ing method illustrated in figure 5.
- a server device is asked to provide additional and/or improved feature values if data transfer connections to and from the server device are available.
- the recognizing of the change of context comprises: obtaining, in a phase 701 , sensing data from the sensing entities, - determining, in a phase 702, a vector of feature values on the basis of the sensing data provided by the sensing entities, checking, in a phase 703, whether the data transfer connections to and from the server device are available, as a response to a situation in which the data transfer connection is available, transmitting in a phase 704 information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and as a response to receiving the at least one second vector of feature values from the server device, using in phases 706 and 707 each second vector of feature values for determining whether the change of context has taken place.
- Each second vector of feature values may represent a complemented and/or more focused, i.e. augmented, version of the vector of feature values determined in the mobile device in the phase 702. Even though the one or more second vectors of the feature values has been asked from the server device, also the vector of feature values determined in the phase 702 is preferably classified in the mobile de- vice in order not to be dependent on whether or not the server device provides the one or more second vectors of feature values within a sufficiently short time. Each second vector of feature values is preferably associated with a time limit after which that particular second vector of feature values is no longer valid. Each second vector of feature values is used for determining whether the change of context has taken place only if that particular second vector of feature values is still valid.
- the phase 707 comprises selecting one of the context classes determined in the phase 706 by: the classification of the vector of feature values, and - the classification of each of the at least one second vector of feature values.
- the change of context is present, a result phase 71 1 , when the selected context class differs, in a decision phase 710, from the previously determined context class.
- the selected context class can be defined to be the one which has a smal- lest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class, i.e. the context class having the best match between its ideal feature vector and a corresponding vector of feature values is the selected context class.
- the server device sends to the mobile terminal, in addition to or instead of the one or more second feature vectors, classification data indicating one or more context classes determined by one or more classifications carried out in the server device.
- the phase 707 comprises selecting, as a response to receiving from the server device the above- mentioned classification data, one of: the context class determined by the classification of the vector of feature values, and the one or more context classes determined by the classifications of the at least one second vector of feature values, and/or - the one or more context classes determined by the one or more classifications carried out in the server device.
- the change of context is present, a result phase 71 1 , when the selected context class differs, in a decision phase 710, from the previously determined context class.
- the selected context class can be defined to be the one which has a smal- lest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class, i.e. the context class having the best match between its ideal feature vector and a corresponding vector of feature values is the selected context class.
- Each context class determined by the one or more classifications carried out in the server device is preferably associated with a time limit after which that particular context class is no longer valid.
- Each context class determined by the one or more classifications carried out in the server device is used for determining whether the change of context has taken place only if that particular context class is still valid.
- the applicability of the recognizing method illustrated in fig- ure 7 is not limited to the methods illustrated in figures 1 -4, but the recognizing method illustrated in figure 7 can be used in various situations where the context and/or the change of context needs to be recognized.
- the same is valid also for a device, e.g. a processing system, arranged execute the recognizing method illustrated in figure 7 and also for a computer program comprising computer executa- ble instructions for controlling a programmable processor to execute the recognizing method illustrated in figure 7.
- FIG 8 shows a mobile device 801 according to an embodiment of the invention.
- the mobile device can be, for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, or a wrist-top device.
- the block 802 represents the internals of the mobile device.
- the mobile device comprises a processing system 804 arranged to: recognize a change of context related to the mobile device and/or a user 812 of the mobile device, gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to a recognized change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action.
- the processing system 804 may comprise one or more processing units each of which may be a programmable processor, a dedicated circuit such as an application specific integrated circuit (ASIC), or a configurable circuit such as a field programmable gate array (FPGA).
- the mobile device further comprises a transceiver 806, a user interface 803, and a memory device 805.
- the processing system 804 is arranged to use, in addition to the usage data for the selection of the service action, history data indicative of control actions given by users of other mobile devices during different changes of context related to the other mobile devices and/or the users of the other mobile devices.
- the mobile device may comprise a data interface, e.g. a universal serial bus interface (USB), for downloading the history data from an external device, or a receiver for receiving the history data via a mobile communication network.
- USB universal serial bus interface
- the processing system 804 is arranged analyze, with a data mining algorithm, correlations be- tween different changes of context and different service actions from a data base comprising the usage data.
- the data base may further comprise the history data.
- a mobile device comprises one or more sensing entities for obtaining sensing data indicative of the context related to the mobile device and/or the user of the mobile device.
- the mobile device may comprise, in addition to or instead of the sensing entities, a data interface for receiving, from one or more external device, sensing data indicative of the context related to the mobile device and/or the user of the mobile device.
- the external devices can be, for example, sensors 813 and 814 attached to the user.
- a sensor attached to the user can be e.g. an accelerometer, a temperature sensor, or a pulse/heart rate sensor.
- the processing system 804 is arranged to recognize the change of context on the basis of the sensing data.
- the processing system 804 is arranged, for recognizing the change of context, to: - determine a vector of feature values on the basis of the sensing data, and classify the vector of feature values to one of alternative context classes, the change of context being present when the context class determined by the classification of the vector of feature values differs from a pre- viously determined context class.
- the processing system 804 is arranged to adapt an algorithm used in the classification on the basis of the vector of feature values and feedback information given by the user.
- the processing system 804 is arranged to adapt the algorithm so that an ideal feature vector of the context class determined by the classification is moved, depending on the feedback information, closer to or farther away from the vector of feature values.
- the ideal feature vector of each context class is such a vector of feature values that best matches with that particular context class and the context class determined by the classification is the one whose ideal feature vector is closest to the vector of feature values in the sense of a pre-determined vector norm.
- the processing system 804 is arranged to: check whether classification of the vector of feature values would fulfill a pre-determined quality criterion, check availability of data transfer connections to and from a server device 815, as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmit the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of the alternative context classes, and as a response to receiving a classification result from the server device, use the classification result received from the server device for determining whether the change of context has taken place.
- the processing system 804 is arranged to calculate the minimum of distances between the vector of feature values and ideal feature vectors of the alternative context classes in order to check whether the classification of the vector of feature values would fulfill the pre-determined quality criterion.
- the distances can be defined in the sense of a pre-determined vector norm, e.g. the 2-norm.
- the processing system 804 is arranged to transmit to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative context classes in a same manner as the classification is carried out by the mobile device.
- the processing system 804 is arranged to recognize the change of context on the basis of whether a context class given by the user differs from the previously determined context class.
- the processing system 804 is arranged to: check availability of the data transfer connections to and from the server device 815, as a response to a situation in which the data transfer connections are available, transmit information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and as a response to receiving the at least one second vector of feature values from the server device, use each second vector of feature values for determining whether the change of context has taken place.
- the processing system 804 is arranged to select one of the context classes determined by: the classification of the vector of feature values, and the classification of each of the at least one second vectors of feature values, and/or one or more classifications carried out in the server device.
- the change of context is deemed to be present when the selected context class differs from the previously determined context class.
- the selected context class may be defined to be the one which has a smallest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class.
- Each second vector of feature values is preferably associated with a time limit, i.e. time-to-live, after which that particular second vector of feature values is no longer valid.
- the processing system is preferably arranged to use each second vector of feature values for determining whether the change of context has taken place only if that particular second vector of feature values is still valid.
- each context class determined by a classification carried out in the server device is preferably associated with a corresponding time limit after which that particular context class is no longer valid, and the processing system is preferably arranged to use each context class for determining, whether the change of context has taken place, only if that particular context class is still valid.
- a computer program comprises a program code for controlling a mobile device on the basis of context awareness.
- the program code comprises instructions executable by a programmable processor for controlling the programmable processor to: recognize a change of context related to the mobile device and/or a user of the mobile device, gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to a recognized change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action.
- the computer executable instructions can be e.g. subroutines and/or functions.
- a computer readable medium e.g. a CD-ROM (Compact Disc Read Only Memory) or a RAM-device (Random Access Memory), according to an embodiment of the invention is encoded with a computer program according to an embodiment of the invention.
- a computer readable medium e.g. a CD-ROM (Compact Disc Read Only Memory) or a RAM-device (Random Access Memory)
- CD-ROM Compact Disc Read Only Memory
- RAM-device Random Access Memory
- a signal according to an embodiment of the invention is encoded with a computer program according to an embodiment of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
- Telephonic Communication Services (AREA)
Abstract
A method for controlling a mobile device on the basis of context awareness comprises: recognizing (101) changes of context related to the mobile device and/or a user of the mobile device, gathering (102) usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, selecting (103), as a response to a change of context, at least one service action from among a pre-determined set of service actions related to services provided with the mobile device at least partly on the basis of the usage data, and controlling (104) the mobile device to perform the selected at least one service action, e.g. adaptation of a user interface of the mobile device. As a consequence of gathering the usage data, the operation of the mobile device in different changes of context can be tailored for the user.
Description
A MOBILE DEVICE CONTROLLED BY CONTEXT AWARENESS
Field of the invention
The invention relates generally to mobile devices. More particularly, the invention relates to a method for controlling a mobile device on the basis of context awareness and to a mobile device arranged to be controlled by context awareness. Furthermore, the invention relates to a computer program for controlling a mobile device on the basis of context awareness.
Background Many mobile devices, such as for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, and a wrist-top device, contain and/or are connected to sensors that may be configured to provide real-time sensing data on the surrounding environment and/or the user of the mobile device. Based on the collected sensing data it is possible to deduce the current context, i.e. the state of the physical environment, the state of the mobile device itself, and/or the physiological state of the user, for example. The information about the context and changes in the context can be utilized in implementing context-aware applications such as for example context-sensitive user interfaces of mobile devices. The challenges in implementing the context-aware applications are two-fold. Firstly, the changes of context should be recognized in a manner that the recognized context corresponds sufficiently well to the real-life situation concerning e.g. the state of the physical environment, the state of the mobile device itself, and/or the physiological state of the user. Publication FI20095570 discloses an adaptive context recognition algorithm which may be initially trained by e.g. supervised adaptation process on the basis of available sensing data vs. indicated context information. The information needed for the supervised adaptation process may be, for example, data collected from a plurality of different users and it may thus provide a generally applicable initial state of the algorithm. After the initial adapta- tion process described above the algorithm may work reasonably well on average. Thereafter, on-line/run-time adaptation may take place upon receiving feedback by the user of the mobile device. The second challenge in implementing the context- aware applications relates to using the information provided by the context recognition for controlling the mobile device in such a manner that the service actions
taken as a response to a recognized change of context correspond sufficiently well to the needs of the user. The service actions are related to services provided with the mobile device and they can be, for example, adaptation of the user interface of the mobile device, adaptation of an application, adaptation of a menu, adaptation of a profile, adaptation of a mode, trigger an application, and/or close an application. Publication US2002167488 discloses a mobile device that includes at least one sensor, such as a tilt sensor implemented by an accelerometer, which provides contextual information, e.g. whether the mobile device is being held or not. When the mobile device receives an incoming message, or notification, the device responds thereto based at least in part upon the contextual information. The control of the mobile device may work reasonably well on average when a sufficiently big group of users is under inspection but, in conjunction with a single user, the operation may, in some situations, be unsatisfactory.
Summary In accordance with the first aspect of the invention there is provided a new mobile device arranged to be controlled by context awareness. The mobile device according to the invention comprises a processing system arranged to: recognize a change of context related to the mobile device and/or a user of the mobile device, - gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to recognizing a change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action.
As the selection of the service action is based at least partly on the usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, the selection can be personalized to correspond to earlier behavior of the user of the mobile device. For example, if the recognized change of context is an arrival at a place on which the user has
typically loaded a certain web-page, the corresponding piece of the usage data may be arranged to indicate that the service action to be selected as a response to the above-mentioned change of context is downloading the above-mentioned web- page. The above-mentioned place can be e.g. a bus-stop in the vicinity of the us- er's home and the above-mentioned web-page can be e.g. a time schedule of a bus operator. The above-mentioned change of context can be recognized e.g. on the basis of a positioning signal provided by a GPS-receiver (Global Positioning System) contained by or connected to the mobile device.
In accordance with the second aspect of the invention there is provided a new me- thod for controlling a mobile device on the basis of context awareness. The method according to the invention comprises: recognizing a change of context related to the mobile device and/or a user of the mobile device, gathering usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to recognizing a change of context, selecting at least one service action at least partly on the basis of the usage data, the at least one service action being selected from among a pre-determined set of ser- vice actions related to services provided with the mobile device, and controlling the mobile device to perform the selected at least one service action.
In accordance with the third aspect of the invention there is provided a new computer program for controlling a mobile device on the basis of context awareness. The computer program according to the invention comprises instructions executable by a programmable processor for controlling the programmable processor to: recognize a change of context related to the mobile device and/or a user of the mobile device, gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context,
as a response to recognizing a change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and - control the mobile device to perform the selected at least one service action.
A computer program product according to the invention comprises a computer readable medium, e.g. a compact disc (CD) or a random access memory (RAM), encoded with a computer program according to the invention. A number of exemplifying embodiments of the invention are described in accompanied dependent claims.
Various exemplifying embodiments of the invention both as to constructions and to methods of operation, together with additional objects and advantages thereof, will be best understood from the following description of specific exemplifying embo- diments when read in connection with the accompanying drawings.
The verb "to comprise" is used in this document as an open limitation that neither excludes nor requires the existence of unrecited features. The features recited in depending claims are mutually freely combinable unless otherwise explicitly stated. Brief description of the figures
The exemplifying embodiments of the invention and their advantages are explained in greater detail below with reference to the accompanying drawings, in which: figure 1 shows a flow chart of a method according to an embodiment of the inven- tion for controlling a mobile device on the basis of context awareness, figure 2 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness, figure 3 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness,
figure 4 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness, figure 5 shows a flow chart of a recognizing method for recognizing a change of context, the recognizing method being usable in a method according to an embo- diment of the invention for controlling a mobile device on the basis of context awareness, figure 6 shows a flow chart of a recognizing method for recognizing a change of context, the recognizing method being usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness, figure 7 shows a flow chart of a recognizing method for recognizing a change of context, the recognizing method being usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness, and figure 8 shows a mobile device according to an embodiment of the invention. Description of the exemplifying embodiments
Figure 1 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness. The mobile device can be, for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, or a wrist-top device. The mobile device may include integrated and/or at least functionally, i.e. wirelessly or in a wired manner, connected sensing entities such as various sensors providing the necessary measurement, or "raw", sensing data for context recognition. The sensing entities may contain specific hardware, such as sensors sensing some physical quantity, and/or specific software to acquire the predetermined sensing data. Some sensing entities may be substantially software-based such as entities acquiring data related to the data stored in the mobile device such as calendar data or device (sw) status data. The sensing entities may include one or more sensors such as accelerome- ters, temperature sensors, location sensors such as a GPS (Global Positioning System) receiver, pulse/heart rate sensors, and/or photometers. Based on the collected sensing data, a change in the current context is deduced, i.e. a change in the state of the physical environment, in the state of the mobile device itself, and/or in the physiological state of the user, for example.
The method comprises recognizing, in a phase 101 , a change of context related to the mobile device and/or a user of the mobile device. The recognition of the change of context can be based on any suitable context recognition algorithm, and some examples will be given later in this document. The recognized change of context may be, for example, an arrival at a place having certain coordinates and it may happen that, after arriving at that place, a user of the mobile device makes the mobile device to download a certain web-page. The aforesaid place can be e.g. a bus-stop and the aforesaid web-page may be e.g. a time schedule of a bus operator. The above-mentioned exemplifying change of context: "the arrival at the aforesaid place" and the exemplifying control action given by the user: "making the mobile device to download the web-page" constitute an exemplifying item of usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context. After a change of context has been recognized in the phase 101 , it is preferably monitored whether the user of the mobile device gives any control actions directed to the mobile device and, in a case the user gives a control action, a new item of the usage data is gathered in a phase 102. The length of a time interval after the change of context and during which it is monitored whether the user of the mobile device gives any control actions can be used as a settable parameter of the gathering functionality. It is also possible to record the time difference between the change of context and the subsequent control operation, this time difference being indicative of strength of correlation between the change of context and the subsequent control operation. As response to the recognized change of context, the following actions are carried out in parallel with the gathering the usage data: - selecting, in a phase 103, at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and controlling, in a phase 104, the mobile device to perform the selected at least one service action.
The selected service action may be, for example, downloading a certain web- page, e.g. the time schedule of the bus operator, as a response to a situation in which the change of context is an arrival at the place having certain coordinates, e.g. a bus-stop, and the usage data contains a data item indicative of correlation between this change of context and this service action. The data item of the usage data may have been gathered, the phase 102, when the user has previously ar-
rived at the aforesaid place. The above-mentioned change of context can be recognized e.g. on the basis of a positioning signal provided by a G PS-receiver contained by or connected to the mobile device. As the selection of the service action is based at least partly on the usage data indicative of earlier control actions given by the user and directed to the mobile device during different recognized changes of context, the selection of the service action can be personalized to correspond to the earlier behavior of the user.
The service action can be, for example, one of the following: adaptation of the user interface of the mobile device, adaptation of an application, adaptation of a menu, adaptation of a profile, adaptation of a mode, trigger an application, close an application, bring forth an application, bring forth a view, minimize a view, activate or terminate a keypad lock, establish a connection, terminate a connection, transmit data, send a message, trigger audio output such as playing a sound, activate tactile feedback such as vibration, activate the display, input data to an application, download a web-page, download a file, upload a file, shut down the mobile device. It should be noted that the above list includes only examples and it is not exhaustive.
Figure 2 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness. Phases 201 , 202 and 204 are similar to the phases 101 , 102 and 104 of the method illustrated in figure 1 . In the method shown in figure 2, the at least one service action is selected in a phase 203 using, in addition to the usage data, history data indicative of control actions given by users of other mobile devices during different changes of context related to the other mobile devices and/or the users of the oth- er mobile devices. The history data can be downloaded to the mobile device from an external device and/or received via a mobile communication network. The history data is especially useful when amount of the usage data gathered in the phase 202 is still low, i.e. the mobile device has been used so short time that a significant usage data has not been gathered yet. Figure 3 shows a flow chart of a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness. Phases 301 , 302 and 304 are similar to the phases 101 , 102 and 104 of the method illustrated in figure 1 . The method shown in figure 3 comprises analyzing, in a phase 303a, correlations between different changes of context and different service ac- tions from a data base comprising the usage data and possibly also the history data. A phase 303 comprises selecting a service action that has greatest correla-
tion with the recognized change of context. The correlations may be analyzed for example with a standard frequency analysis or with sophisticated data mining algorithms.
Figure 4 shows a flow chart of a method according to an embodiment of the inven- tion for controlling a mobile device on the basis of context awareness. Phases 401 , 402, 403 and 404 are similar to the phases 301 , 302, 303 and 304 of the method illustrated in figure 3. The method shown in figure 4 comprises transmitting, in a phase 402a, a gathered usage data item to a server device via a mobile communication network and receiving, in a phase 402b, data indicative of correlations between various possible changes of context and various possible selectable service actions. Therefore, the analysis of the usage data and possibly also of the history data is carried out in the server device instead of the mobile device. Hence, the mobile device is not self-contained as to the method illustrated in figure 4, but the computational, memory, and battery resources of the mobile device can be spared instead.
Figure 5 shows a flow chart of a recognizing method for recognizing a change of context. The recognizing method is usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness. The recognizing method shown in figure 5 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4. It is also possible to use the recognizing method illustrated in figure 5 in conjunction with other applications wherein the context and/or the change of context needs to be recognized. The recognizing of the change of context comprises: obtaining, in a phase 501 , sensing data from sensing entities such as, for example, accelerometers, temperature sensors, location sensors, pulse/heart rate sensors, photometers, entities for acquiring data related to the data stored in the mobile device, and/or entities for acquiring device status data, determining, in a phase 502, a vector of feature values on the basis of the sensing data provided by the sensing entities, and classifying, in a phase 503, the vector of feature values to one of predefined alternative context classes.
The change of context is present, a result phase 508, when the context class determined by the classification of the vector of feature values differs from a pre-
viously determined context class; a decision phase 507. The previously determined context class is the context class recognized after the previous change of context. The determination of the vector of feature values and the classification, the phases 502 and 503, are described below only in view of general principles. A more detailed description for these method phases can be found e.g. in FI20095570.
For the classification it is possible use a vast number of different features the values of which are determined on the basis of the sensing data. However, it is both computationally and memory-wise advantageous to use as few of features as possible in the actual classification. Determining feature values from the sensing data typically requires certain computation and it is even possible to attain subop- timal results, if too many features are used. Preferably, substantially linearly separable features are selected for the classification. The Sequential Forward Selection (SFS) is an exemplifying method for feature selection that can be applied in conjunction with the method shown in figure 5. The basic principle in the SFS- algorithm is to add a feature that increases the classification accuracy most to the current pool of features at each step. Hence, the SFS-algorithm performs optimization in the feature space. Another exemplifying method is the Sequential Backward Selection (SBS) that starts with the full set of features and gradually removes features from the pool. As a further example, in Sequential Floating Forward Selection (SFFS) the procedure includes two parts. A new feature for the subset is added by the SFS-method. The worst feature is then conditionally excluded until no improvement is made to the previous sets. This method avoids the nesting effect of the SFS-method, in which the discarded features cannot be selected any- more. The inclusion and exclusion of a feature is deduced using a criterion value. It can be e.g. a distance measure or a classification result. To explain the algorithm more thoroughly, a new feature, which gives the best criterion with the previously selected features, is added to the feature subset according to the SFS- method. A conditional exclusion is applied to the new feature set, from which the least significant feature is determined. If the least significant feature is the last one added, the algorithm goes back to selecting a new feature by the SFS-method. Otherwise the least significant feature is excluded and moved back to the set of available features and conditional exclusion is continued. Again, the least significant feature is determined and the criterion without this feature is compared to the criterion with the same number of features in the memory. If the criterion is improved, the feature is excluded and moved back to the set of available features and this step is repeated until no further improvement is made. The cycle starts all
over again by adding a new feature until the previously defined subset size is reached.
Table 1 presents an exemplifying set of features which can be used for distinguishing the following exemplifying activities from each others: outdoor bicycling, soccer playing, lying, nordic walking, rowing with the rowing machine, running, sitting, standing, and walking. The sensing entities are acceleration sensors attached to the wrist and hip of the user.
Table 1. An exemplifying set of features for classification.
The classification in the phase 503 can be, for example, the minimum-distance classification that represents a rather straightforward way to accomplish the classification of the vector of feature values. The basic principle of the minimum- distance classification is to calculate distances from the vector of feature values to be classified to ideal feature vectors each of which representing a respective con- text class in the best possible way, and then to select the context class to the ideal feature vector of which the distance is smallest. The distances can be defined in the sense of a suitable vector norm, e.g. the 2-norm. If the feature values are represented in an N-dimensional vector space then there will be N-1 dimensional hyperplane separating each context class. In such case, e.g. a mean value of rep- resentative vectors of feature values belonging to a certain context class can be used as the ideal feature vector of that context class.
The algorithm used in the classification can be adapted to correspond better to the specific needs of the user on the basis of the vector of feature values to be classified and feedback information given by the user. The feedback can be direct feed- back which explicitly indicates the desired context class for certain sensing data
and for the corresponding vector of feature values. The user may therefore, through the direct feedback, assist and cultivate the classification algorithm when the user sees it appropriate. As the user directly indicates the desired context class, it is not necessary to execute an automated classification round for the cor- responding vector of feature values. Instead, the classification may utilize the data and/or the corresponding feature values for adapting the classification algorithm. In addition to or as an alternative of the direct feedback, the algorithm used in the classification can be adapted on the basis of indirect feedback given by the user. The indirect feedback is feedback which is obtained after the classification action as indication of the quality and correctness of the automatically performed classification. The indirect feedback may indicate, for example one of the following alternatives: the user is highly satisfied with the outcome of the classification, the user is satisfied with the outcome of the classification, the user is dissatisfied with the outcome of the classification, and the user is highly dissatisfied with the outcome of the classification.
In conjunction with the minimum-distance classification algorithm, the adaptation phase 506 may comprise moving the ideal feature vector of the context class determined by the classification or by the direct feedback closer to or farther away from the vector of feature values to be classified, the direction of the movement depending on the feedback information. A more detailed description of the adaptation of the minimum-distance classification algorithm can be found e.g. in FI20095570.
Figure 6 shows a flow chart of a recognizing method for recognizing a change of context. The recognizing method is usable in a method according to an embodi- ment of the invention for controlling a mobile device on the basis of context awareness. The recognizing method shown in figure 6 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4. The recognizing method illustrated in figure 6 is a further development of the recognizing method illustrated in figure 5. In the recognizing method illustrated in figure 6, a server device is asked to assist in the classification if data transfer connections to and from the server device are available and if the classification task might be too complicated for being performed by the mobile device in a reasonable time with a sufficient quality. Even though the assistance has been asked, the classification is preferably carried out in the mobile device in order not to be dependent on wheth- er or not the server device provides a classification result within a sufficiently short time. The recognizing of the change of context comprises:
obtaining, in a phase 601 , sensing data from the sensing entities, determining, in a phase 602, a vector of feature values on the basis of the sensing data provided by the sensing entities, checking, in a phase 603, whether classification of the vector of fea- ture values would fulfill a pre-determined quality criterion and whether the data transfer connections to and from the server device are available, as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmitting in a phase 604 the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of pre-defined alternative context classes, classifying, in an optional but non-necessary phase 605, the vector of feature values to one of the pre-defined alternative context classes in order not to be dependent on whether or not the server device provides a classifi- cation result, as a response to receiving a classification result from the server device, using in a phase 607 the classification result received from the server device for determining whether the change of context has taken place.
The classification result, i.e. a determined context class, received from the server device is preferably used for determining whether or not a change of context has occurred. However, if the user of the mobile device gives a context class, e.g. as feedback information, this context class given by the user is preferably used for determining whether or not the change of context has occurred. The phases 609, 610, and 61 1 of the recognizing method illustrated in figure 6 can be similar to the corresponding phases 506, 507, and 508 of the recognizing method illustrated in figure 5, respectively.
In a recognizing method according to an embodiment, the phase 603 comprises calculating the minimum of distances between the vector of feature values and the ideal feature vector of the alternative context classes in order to check whether the classification of the vector of feature values would fulfill the pre-determined quality criterion. The quality criterion can be, for example, such that the minimum of the distances should be below a pre-determined limit value. The distances can be defined in the sense of a suitable vector norm, e.g. the 2-norm.
In a recognizing method according to an embodiment, the phase 604 further comprises transmitting to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative context classes in a same manner as the classification is carried out in the mobile device.
It should be noted that the applicability of the recognizing method illustrated in figure 6 is not limited to the methods illustrated in figures 1 -4, but the recognizing method illustrated in figure 6 can be used in various situations where the context and/or the change of context needs to be recognized. The same is valid also for a device, e.g. a processing system, arranged execute the recognizing method illustrated in figure 6 and also for a computer program comprising computer executable instructions for controlling a programmable processor to execute the recognizing method illustrated in figure 6.
Figure 7 shows a flow chart of a recognizing method for recognizing a change of context. The recognizing method is usable in a method according to an embodiment of the invention for controlling a mobile device on the basis of context awareness. The recognizing method shown in figure 7 can be used, for example, as the phases 101 , 201 , 301 , and 401 of the methods illustrated in figures 1 -4. The recognizing method illustrated in figure 7 is a further development of the recogniz- ing method illustrated in figure 5. In the recognizing method illustrated in figure 7, a server device is asked to provide additional and/or improved feature values if data transfer connections to and from the server device are available. The recognizing of the change of context comprises: obtaining, in a phase 701 , sensing data from the sensing entities, - determining, in a phase 702, a vector of feature values on the basis of the sensing data provided by the sensing entities, checking, in a phase 703, whether the data transfer connections to and from the server device are available, as a response to a situation in which the data transfer connection is available, transmitting in a phase 704 information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and
as a response to receiving the at least one second vector of feature values from the server device, using in phases 706 and 707 each second vector of feature values for determining whether the change of context has taken place. Each second vector of feature values may represent a complemented and/or more focused, i.e. augmented, version of the vector of feature values determined in the mobile device in the phase 702. Even though the one or more second vectors of the feature values has been asked from the server device, also the vector of feature values determined in the phase 702 is preferably classified in the mobile de- vice in order not to be dependent on whether or not the server device provides the one or more second vectors of feature values within a sufficiently short time. Each second vector of feature values is preferably associated with a time limit after which that particular second vector of feature values is no longer valid. Each second vector of feature values is used for determining whether the change of context has taken place only if that particular second vector of feature values is still valid.
In a method according to an embodiment, the phase 707 comprises selecting one of the context classes determined in the phase 706 by: the classification of the vector of feature values, and - the classification of each of the at least one second vector of feature values.
The change of context is present, a result phase 71 1 , when the selected context class differs, in a decision phase 710, from the previously determined context class. The selected context class can be defined to be the one which has a smal- lest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class, i.e. the context class having the best match between its ideal feature vector and a corresponding vector of feature values is the selected context class.
It is also possible that the server device sends to the mobile terminal, in addition to or instead of the one or more second feature vectors, classification data indicating one or more context classes determined by one or more classifications carried out in the server device. In a method according to an embodiment, the phase 707 comprises selecting, as a response to receiving from the server device the above- mentioned classification data, one of:
the context class determined by the classification of the vector of feature values, and the one or more context classes determined by the classifications of the at least one second vector of feature values, and/or - the one or more context classes determined by the one or more classifications carried out in the server device.
The change of context is present, a result phase 71 1 , when the selected context class differs, in a decision phase 710, from the previously determined context class. The selected context class can be defined to be the one which has a smal- lest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class, i.e. the context class having the best match between its ideal feature vector and a corresponding vector of feature values is the selected context class. Each context class determined by the one or more classifications carried out in the server device is preferably associated with a time limit after which that particular context class is no longer valid. Each context class determined by the one or more classifications carried out in the server device is used for determining whether the change of context has taken place only if that particular context class is still valid.
It should be noted that the applicability of the recognizing method illustrated in fig- ure 7 is not limited to the methods illustrated in figures 1 -4, but the recognizing method illustrated in figure 7 can be used in various situations where the context and/or the change of context needs to be recognized. The same is valid also for a device, e.g. a processing system, arranged execute the recognizing method illustrated in figure 7 and also for a computer program comprising computer executa- ble instructions for controlling a programmable processor to execute the recognizing method illustrated in figure 7.
Figure 8 shows a mobile device 801 according to an embodiment of the invention. The mobile device can be, for example a mobile phone, a personal digital assistant (PDA), a smart-phone, a lap-top computer, or a wrist-top device. The block 802 represents the internals of the mobile device. The mobile device comprises a processing system 804 arranged to: recognize a change of context related to the mobile device and/or a user 812 of the mobile device,
gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to a recognized change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action. The processing system 804 may comprise one or more processing units each of which may be a programmable processor, a dedicated circuit such as an application specific integrated circuit (ASIC), or a configurable circuit such as a field programmable gate array (FPGA). Preferably, the mobile device further comprises a transceiver 806, a user interface 803, and a memory device 805.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to use, in addition to the usage data for the selection of the service action, history data indicative of control actions given by users of other mobile devices during different changes of context related to the other mobile devices and/or the users of the other mobile devices. The mobile device may comprise a data interface, e.g. a universal serial bus interface (USB), for downloading the history data from an external device, or a receiver for receiving the history data via a mobile communication network.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged analyze, with a data mining algorithm, correlations be- tween different changes of context and different service actions from a data base comprising the usage data. The data base may further comprise the history data.
A mobile device according to an embodiment of the invention comprises one or more sensing entities for obtaining sensing data indicative of the context related to the mobile device and/or the user of the mobile device. The mobile device may comprise, in addition to or instead of the sensing entities, a data interface for receiving, from one or more external device, sensing data indicative of the context related to the mobile device and/or the user of the mobile device. The external devices can be, for example, sensors 813 and 814 attached to the user. A sensor attached to the user can be e.g. an accelerometer, a temperature sensor, or a
pulse/heart rate sensor. The processing system 804 is arranged to recognize the change of context on the basis of the sensing data.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged, for recognizing the change of context, to: - determine a vector of feature values on the basis of the sensing data, and classify the vector of feature values to one of alternative context classes, the change of context being present when the context class determined by the classification of the vector of feature values differs from a pre- viously determined context class.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to adapt an algorithm used in the classification on the basis of the vector of feature values and feedback information given by the user.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to adapt the algorithm so that an ideal feature vector of the context class determined by the classification is moved, depending on the feedback information, closer to or farther away from the vector of feature values. The ideal feature vector of each context class is such a vector of feature values that best matches with that particular context class and the context class determined by the classification is the one whose ideal feature vector is closest to the vector of feature values in the sense of a pre-determined vector norm.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to: check whether classification of the vector of feature values would fulfill a pre-determined quality criterion, check availability of data transfer connections to and from a server device 815, as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmit the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of the alternative context classes, and
as a response to receiving a classification result from the server device, use the classification result received from the server device for determining whether the change of context has taken place.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to calculate the minimum of distances between the vector of feature values and ideal feature vectors of the alternative context classes in order to check whether the classification of the vector of feature values would fulfill the pre-determined quality criterion. The distances can be defined in the sense of a pre-determined vector norm, e.g. the 2-norm. In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to transmit to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative context classes in a same manner as the classification is carried out by the mobile device. In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to recognize the change of context on the basis of whether a context class given by the user differs from the previously determined context class.
In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to: check availability of the data transfer connections to and from the server device 815, as a response to a situation in which the data transfer connections are available, transmit information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and as a response to receiving the at least one second vector of feature values from the server device, use each second vector of feature values for determining whether the change of context has taken place. In a mobile device according to an embodiment of the invention, the processing system 804 is arranged to select one of the context classes determined by: the classification of the vector of feature values, and
the classification of each of the at least one second vectors of feature values, and/or one or more classifications carried out in the server device.
The change of context is deemed to be present when the selected context class differs from the previously determined context class. The selected context class may be defined to be the one which has a smallest distance between its ideal feature vector and a corresponding vector of feature values which has been classified to that context class. Each second vector of feature values is preferably associated with a time limit, i.e. time-to-live, after which that particular second vector of feature values is no longer valid. The processing system is preferably arranged to use each second vector of feature values for determining whether the change of context has taken place only if that particular second vector of feature values is still valid. Furthermore, each context class determined by a classification carried out in the server device is preferably associated with a corresponding time limit after which that particular context class is no longer valid, and the processing system is preferably arranged to use each context class for determining, whether the change of context has taken place, only if that particular context class is still valid.
A computer program according to an embodiment of the invention comprises a program code for controlling a mobile device on the basis of context awareness. The program code comprises instructions executable by a programmable processor for controlling the programmable processor to: recognize a change of context related to the mobile device and/or a user of the mobile device, gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, as a response to a recognized change of context, select at least one service action at least partly on the basis of the usage data, the at least one service action being selectable from among a pre-determined set of service actions related to services provided with the mobile device, and control the mobile device to perform the selected at least one service action.
The computer executable instructions can be e.g. subroutines and/or functions.
A computer readable medium, e.g. a CD-ROM (Compact Disc Read Only Memory) or a RAM-device (Random Access Memory), according to an embodiment of the invention is encoded with a computer program according to an embodiment of the invention.
A signal according to an embodiment of the invention is encoded with a computer program according to an embodiment of the invention.
The specific examples provided in the description given above should not be construed as limiting. Therefore, the invention is not limited merely to the embodiments described above, many variants being possible.
Claims
1 . A mobile device (801 ) comprising a processing system (804) arranged to: recognize a change of context related to the mobile device and/or a user of the mobile device, and - control the mobile device to perform at least one service action related to services provided with the mobile device as a response to a recognized change of context, characterized in that the processing system is further arranged to: gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, and select, prior to performing the at least one service action, the at least one service action from among a pre-determined set of service actions at least partly on the basis of the usage data.
2. A mobile device according to claim 1 , wherein the processing system is arranged to use, in addition to the usage data for the selection of the service action, history data indicative of control actions given by users of other mobile devices during different changes of context related to the other mobile devices and/or the users of the other mobile devices.
3. A mobile device according to claim 1 , wherein the processing system is arranged analyze, with a data mining algorithm, correlations between different changes of context and different service actions from a data base comprising the usage data.
4. A mobile device according to claim 2, wherein the processing system is ar- ranged analyze, with a data mining algorithm, correlations between different changes of context and different service actions from a data base comprising the usage data and the history data.
5. A mobile device according to claim 2, comprising a data interface for downloading the history data from an external device.
6. A mobile device according to claim 2, comprising a receiver for receiving the history data via a mobile communication network.
7. A mobile device according to any of claims 1 -6, comprising one or more sensing entities for obtaining sensing data indicative of the context related to the mobile device and/or the user of the mobile device, the processing system being arranged to recognize the change of context on the basis of the sensing data.
8. A mobile device according to any of claims 1 -6, comprising a data interface for receiving, from one or more external device, sensing data indicative of the context related to the mobile device and/or the user of the mobile device, the processing system being arranged to recognize the change of context on the basis of the sensing data.
9. A mobile device according to claim 7 or 8, wherein the processing system is arranged, for recognizing the change of context, to: determine a vector of feature values on the basis of the sensing data, and classify the vector of feature values to one of alternative context classes, the change of context being present when the context class determined by the classification of the vector of feature values differs from a previously determined context class.
10. A mobile device according to claim 9, wherein the processing system is arranged to adapt an algorithm used in the classification on the basis of the vector of feature values and feedback information given by the user.
1 1 . A mobile device according to claim 10, wherein the processing system is arranged to adapt the algorithm so that an ideal feature vector of the context class determined by the classification is moved, depending on the feedback information, closer to or farther away from the vector of feature values, the ideal feature vector of each context class being such a vector of feature values that best matches with that particular context class and the context class determined by the classification being the one whose ideal feature vector is closest to the vector of feature values in the sense of a pre-determined vector norm.
12. A mobile device according to any of claims 9-1 1 , wherein the processing system is arranged to: check whether classification of the vector of feature values would fulfill a pre-determined quality criterion, check availability of data transfer connections to and from a server device, - as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmit the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of the alternative context classes, and - as a response to receiving a classification result from the server device, use the classification result received from the server device for determining whether the change of context has taken place.
13. A mobile device according to claim 12, wherein the processing system is arranged to calculate the minimum of distances between the vector of feature values and ideal feature vectors of the alternative context classes in order to check whether the classification of the vector of feature values would fulfill the predetermined quality criterion, the distances being defined in the sense of a predetermined vector norm and the ideal feature vector of each context class being such a vector of feature values that best matches with that particular context class.
14. A mobile device according to claim 13, wherein the processing system is arranged to transmit to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative context classes in a same manner as the classification is carried out by the mobile device.
15. A mobile device according to any of claims 9-14, wherein the processing system is arranged to recognize the change of context on the basis of whether a context class given by the user differs from the previously determined context class.
16. A mobile device according to any of claims 9-15, wherein the processing system is arranged to: - check availability of the data transfer connections to and from the server device, as a response to a situation in which the data transfer connections are available, transmit information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and - as a response to receiving the at least one second vector of feature values from the server device, use each second vector of feature values for determining whether the change of context has taken place.
17. A mobile device according to claim 16, wherein the processing system is arranged to select one of the context classes determined by: - the classification of the vector of feature values, and the classification of each of the at least one second vectors of feature values, the change of context being present when the selected context class differs from the previously determined context class.
18. A mobile device according to claim 16, wherein the processing system is arranged to select, as a response to receiving from the server device data indicating at least one context class determined by one or more classifications carried out in the server device, one of the context classes determined by: the classification of the vector of feature values, - the classifications of the at least one second vector of feature values, and the one or more classifications carried out in the server device, the change of context being present when the selected context class differs from the previously determined context class.
19. A mobile device according to claim 17 or 18, wherein the selected context class is the one which has a smallest distance between its ideal feature vector and a corresponding vector of feature values which has been classified, the distance being defined in the sense of a pre-determined vector norm and the ideal feature vector of each context class being such a vector of feature values that best matches with that particular context class.
20. A mobile device according to any of claims 16-19, wherein each second vector of feature values is associated with a time limit after which that particular second vector of feature values is no longer valid, and the processing system is arranged to use each second vector of feature values for determining whether the change of context has taken place only if that particular second vector of feature values is still valid.
21 . A mobile device according to any of claims 18-20, wherein each of the at least one context class determined by the one or more classifications carried out in the server device is associated with a time limit after which that particular context class is no longer valid, and the processing system is arranged to use each of the at least one context class determined by the one or more classifications carried out in the server device for determining, whether the change of context has taken place, only if that particular context class is still valid.
22. A method comprising: - recognizing (101 , 201 , 301 , 401 ) a change of context related to a mobile device and/or a user of the mobile device, and controlling (104, 204, 304, 404) the mobile device to perform at least one service action related to services provided with the mobile device as a response to a recognized change of context, characterized in that the method further comprises: gathering (102, 202, 302, 402) usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, and selecting (103, 203, 303, 403), prior to performing the at least one service action, the at least one service action from among a pre-determined set of service actions at least partly on the basis of the usage data.
23. A method according to claim 22, wherein the at least one service action is selected (203) using, in addition to the usage data, history data indicative of control actions given by users of other mobile devices during different changes of con- text related to the other mobile devices and/or the users of the other mobile devices.
24. A method according to claim 22, comprising analyzing (303a), with a data mining algorithm, correlations between different changes of context and different service actions from a data base comprising the usage data.
25. A method according to claim 23, comprising analyzing (303a), with a data mining algorithm, correlations between different changes of context and different service actions from a data base comprising the usage data and the history data.
26. A method according to claim 22, comprising downloading the history data from an external device.
27. A method according to claim 22, comprising receiving the history data via a mobile communication network.
28. A method according to any of claims 22-27, comprising obtaining, with one or more sensing entities, sensing data indicative of the context related to the mobile device and/or the user of the mobile device, the change of context being recognized on the basis of the sensing data.
29. A method according to any of claims 22-27, comprising receiving, from one or more external device, sensing data indicative of the context related to the mobile device and/or the user of the mobile device, the change of context being recognized on the basis of the sensing data.
30. A method according to claim 28 or 29, wherein the recognizing (101 , 201 , 301 , 401 ) of the change of context comprises: determining (502, 602, 702) a vector of feature values on the basis of the sensing data, and classifying (503, 605, 706) the vector of feature values to one of alternative context classes, the change of context being present (508, 71 1 , 61 1 ) when the context class determined by the classification of the vector of feature values differs (507, 710, 610) from a previously determined context class.
31 . A method according to claim 30, comprising adapting (506, 609, 709) an algorithm used in the classification on the basis of the vector of feature values and feedback information given by the user.
32. A method according to claim 31 , wherein the algorithm is adapted so that an ideal feature vector of the context class determined by the classification is moved, depending on the feedback information, closer to or farther away from the vector of feature values, the ideal feature vector of each context class being such a vec- tor of feature values that best matches with that particular context class and the context class determined by the classification being the one whose ideal feature vector is closest to the vector of feature values in the sense of a pre-determined vector norm.
33. A method according to any of claims 30-32, wherein the recognizing (101 , 201 , 301 , 401 ) of the change of context comprises: checking (603) whether classification of the vector of feature values would fulfill a pre-determined quality criterion, checking (603) availability of data transfer connections to and from a server device, - as a response to a situation in which the data transfer connections are available and the classification would not fulfill the pre-determined quality criterion, transmitting (604) the vector of feature values to the server device in order to enable the server device to classify the vector of feature values to one of the alternative context classes, and - as a response to receiving a classification result from the server device, using (607) the classification result received from the server device for determining whether the change of context has taken place.
34. A method according to claim 33, comprising calculating the minimum of distances between the vector of feature values and ideal feature vectors of the alter- native context classes in order to check whether the classification of the vector of feature values would fulfill the pre-determined quality criterion, the distances being defined in the sense of a pre-determined vector norm and the ideal feature vector of each context class being such a vector of feature values that best matches with that particular context class.
35. A method according to claim 34, comprising transmitting to the server device the ideal feature vector of one or more of the context classes in order to enable the server device to classify the vector of feature values to one of the alternative con- text classes in a same manner as the classification is carried out in the mobile device.
36. A method according to any of claims 30-35, comprising recognizing the change of context on the basis of whether a context class given by the user differs from the previously determined context class.
37. A method according to any of claims 30-36, wherein the recognizing of the change of context comprises: checking (703) availability of data transfer connections to and from the server device, - as a response to a situation in which the data transfer connection is available, transmitting (704) information based on the sensing data to a server device in order to enable the server device to form at least one second vector of feature values, and as a response to receiving the at least one second vector of feature values from the server device, using (706, 707) each second vector of feature values for determining whether the change of context has taken place.
38. A method according to claim 37, comprising selecting (707) one of the context classes determined (706) by: the classification of the vector of feature values, and - the classification of each of the at least one second vector of feature values, the change of context being present (71 1 ) when the selected context class differs (710) from the previously determined context class.
39. A method according to claim 37, comprising selecting, as a response to re- ceiving from the server device data indicating at least one context class determined by one or more classifications carried out in the server device, one of the context classes determined by: the classification of the vector of feature values, the classifications of the at least one second vector of feature values, and the one or more classifications carried out in the server device, the change of context being present when the selected context class differs from the previously determined context class.
40. A method according to claim 38 or 39, wherein the selected context class is the one which has a smallest distance between its ideal feature vector and a corresponding vector of feature values which has been classified, the distance being defined in the sense of a pre-determined vector norm and the ideal feature vector of each context class being such a vector of feature values that best matches with that particular context class.
41 . A method according to any of claims 37-40, wherein each second vector of feature values is associated with a time limit after which that particular second vector of feature values is no longer valid, and each second vector of feature values is used for determining whether the change of context has taken place only if that particular second vector of feature values is still valid.
42. A method according to any of claims 39-41 , wherein each of the at least one context class determined by the one or more classifications carried out in the server device is associated with a time limit after which that particular context class is no longer valid, and each of the at least one context class determined by the one or more classifications carried out in the server device is used for deter- mining whether the change of context has taken place only if that particular context class is still valid.
43. A computer program comprising instructions executable by a programmable processor for controlling the programmable processor to: recognize a change of context related to a mobile device and/or a us- er of the mobile device, and control the mobile device to perform at least one service action related to services provided with the mobile device as a response to a recognized change of context, characterized in that the computer program further comprises instructions ex- ecutable by the programmable processor for controlling the programmable processor to: gather usage data indicative of control actions given by the user and directed to the mobile device during different recognized changes of context, and select, prior to performing the at least one service action, the at least one service action from among a pre-determined set of service actions at least partly on the basis of the usage data.
44. A computer readable medium encoded with a computer program according to claim 43.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10829574.2A EP2499844B1 (en) | 2009-11-11 | 2010-11-09 | A mobile device controlled by context awareness |
US13/509,298 US8990384B2 (en) | 2009-11-11 | 2010-11-09 | Mobile device controlled by context awareness |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FI20096172 | 2009-11-11 | ||
FI20096172A FI122770B (en) | 2009-11-11 | 2009-11-11 | A mobile device controlled by context awareness |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011058224A1 true WO2011058224A1 (en) | 2011-05-19 |
Family
ID=41395221
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FI2010/050901 WO2011058224A1 (en) | 2009-11-11 | 2010-11-09 | A mobile device controlled by context awareness |
Country Status (4)
Country | Link |
---|---|
US (1) | US8990384B2 (en) |
EP (1) | EP2499844B1 (en) |
FI (1) | FI122770B (en) |
WO (1) | WO2011058224A1 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013167190A1 (en) * | 2012-05-10 | 2013-11-14 | Telefonaktiebolaget L M Ericsson (Publ) | A method and apparatus to adapt the data traffic of a communication between a user equipment and a communication network |
WO2013190380A3 (en) * | 2012-06-21 | 2014-05-15 | Cellepathy Ltd. | Device context determination |
US8750853B2 (en) | 2010-09-21 | 2014-06-10 | Cellepathy Ltd. | Sensor-based determination of user role, location, and/or state of one or more in-vehicle mobile devices and enforcement of usage thereof |
WO2014055376A3 (en) * | 2012-10-04 | 2014-06-26 | Bjontegard Bernt Erik | Contextually intelligent communication systems and processes |
CN104094287A (en) * | 2011-12-21 | 2014-10-08 | 诺基亚公司 | A method, an apparatus and a computer software for context recognition |
EP2815592A4 (en) * | 2012-02-15 | 2015-09-02 | Flybits Inc | Zone oriented systems |
US9312713B2 (en) | 2012-03-20 | 2016-04-12 | Sensirion Ag | Heating a sensitive layer of a chemical sensor subject to detection of a recharge process in an electronic device |
US9691115B2 (en) | 2012-06-21 | 2017-06-27 | Cellepathy Inc. | Context determination using access points in transportation and other scenarios |
US9772317B2 (en) | 2012-07-26 | 2017-09-26 | Sensirion Ag | Method for operating a portable electronic device |
US9800716B2 (en) | 2010-09-21 | 2017-10-24 | Cellepathy Inc. | Restricting mobile device usage |
US10659594B2 (en) | 2015-02-12 | 2020-05-19 | American University Of Beirut | Context aware mobile personalization system and methods of use |
US11070661B2 (en) | 2010-09-21 | 2021-07-20 | Cellepathy Inc. | Restricting mobile device usage |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012065101A1 (en) * | 2010-11-13 | 2012-05-18 | Madey Daniel A | Context-based dynamic policy system for mobile devices and supporting network infrastructure |
US20130297416A1 (en) | 2010-12-09 | 2013-11-07 | Checkpoints Llc | Systems, apparatuses and methods for verifying consumer activity and providing value to consumers based on consumer activity |
US8677112B2 (en) * | 2011-04-29 | 2014-03-18 | Sap Ag | Automatic notification based on generic storage framework |
US8725869B1 (en) * | 2011-09-30 | 2014-05-13 | Emc Corporation | Classifying situations for system management |
JP5945006B2 (en) | 2012-02-10 | 2016-07-05 | エンパイア テクノロジー ディベロップメント エルエルシー | Data transmission in cloud-based systems |
US9614843B2 (en) * | 2012-03-08 | 2017-04-04 | Nokia Technologies Oy | Context-aware adaptive authentication method and apparatus |
US11468243B2 (en) | 2012-09-24 | 2022-10-11 | Amazon Technologies, Inc. | Identity-based display of text |
US8864587B2 (en) | 2012-10-03 | 2014-10-21 | Sony Corporation | User device position indication for security and distributed race challenges |
KR20140062886A (en) * | 2012-11-15 | 2014-05-26 | 엘지전자 주식회사 | Mobile terminal and control method thereof |
US9654977B2 (en) | 2012-11-16 | 2017-05-16 | Visa International Service Association | Contextualized access control |
US10649619B2 (en) * | 2013-02-21 | 2020-05-12 | Oath Inc. | System and method of using context in selecting a response to user device interaction |
US8795138B1 (en) * | 2013-09-17 | 2014-08-05 | Sony Corporation | Combining data sources to provide accurate effort monitoring |
US9946893B2 (en) * | 2013-11-26 | 2018-04-17 | Nokia Technologies Oy | Method and apparatus for providing privacy profile adaptation based on physiological state change |
US9269119B2 (en) | 2014-01-22 | 2016-02-23 | Sony Corporation | Devices and methods for health tracking and providing information for improving health |
US9667772B1 (en) | 2016-06-17 | 2017-05-30 | International Business Machines Corporation | Transient, context-dependent grouping of content for mobile device display |
US10452410B2 (en) | 2016-10-25 | 2019-10-22 | International Business Machines Corporation | Context aware user interface |
US11368457B2 (en) | 2018-02-20 | 2022-06-21 | Visa International Service Association | Dynamic learning system for intelligent authentication |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030187984A1 (en) * | 2002-03-29 | 2003-10-02 | International Business Machines Corporation | Method and apparatus for content pre-fetching and preparation |
WO2008140358A1 (en) * | 2007-05-10 | 2008-11-20 | Telefonaktiebolaget Lm Ericsson (Publ) | A method and apparatus for providing customised services in a communication network |
US20090070283A1 (en) * | 2007-09-11 | 2009-03-12 | Electronics And Telecommunications Research Institute | Apparatus and method of constructing user behavior pattern based on event log generated from context-aware system environment |
US20090271148A1 (en) * | 2008-04-25 | 2009-10-29 | Samsung Electronics Co., Ltd. | Cold-start in situation-aware systems |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7302280B2 (en) | 2000-07-17 | 2007-11-27 | Microsoft Corporation | Mobile phone operation based upon context sensing |
US6901398B1 (en) * | 2001-02-12 | 2005-05-31 | Microsoft Corporation | System and method for constructing and personalizing a universal information classifier |
US7409423B2 (en) * | 2001-06-28 | 2008-08-05 | Horvitz Eric J | Methods for and applications of learning and inferring the periods of time until people are available or unavailable for different forms of communication, collaboration, and information access |
US7069259B2 (en) * | 2002-06-28 | 2006-06-27 | Microsoft Corporation | Multi-attribute specification of preferences about people, priorities and privacy for guiding messaging and communications |
EP1556799A2 (en) * | 2002-10-21 | 2005-07-27 | Koninklijke Philips Electronics N.V. | Method of and system for presenting media content to a user or group of users, computer program product, information carrier, entertainment device |
US7831679B2 (en) * | 2003-10-15 | 2010-11-09 | Microsoft Corporation | Guiding sensing and preferences for context-sensitive services |
JP5224689B2 (en) * | 2004-11-26 | 2013-07-03 | 富士通株式会社 | Network service control method |
KR100876559B1 (en) | 2006-12-05 | 2008-12-31 | 한국전자통신연구원 | Mobile terminal-oriented situation recognition service providing method and mobile terminal using the same |
US8160560B2 (en) | 2007-03-02 | 2012-04-17 | Aegis Mobility, Inc. | Management of mobile device communication sessions to reduce user distraction |
KR101074987B1 (en) * | 2007-11-06 | 2011-10-18 | 한국전자통신연구원 | Context based rfid privacy control system and the applicable methods for personalization of tagged product |
FI20095570L (en) * | 2009-05-22 | 2009-09-11 | Valtion Teknillinen | Context recognition in mobile devices |
-
2009
- 2009-11-11 FI FI20096172A patent/FI122770B/en active IP Right Grant
-
2010
- 2010-11-09 EP EP10829574.2A patent/EP2499844B1/en active Active
- 2010-11-09 WO PCT/FI2010/050901 patent/WO2011058224A1/en active Application Filing
- 2010-11-09 US US13/509,298 patent/US8990384B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030187984A1 (en) * | 2002-03-29 | 2003-10-02 | International Business Machines Corporation | Method and apparatus for content pre-fetching and preparation |
WO2008140358A1 (en) * | 2007-05-10 | 2008-11-20 | Telefonaktiebolaget Lm Ericsson (Publ) | A method and apparatus for providing customised services in a communication network |
US20090070283A1 (en) * | 2007-09-11 | 2009-03-12 | Electronics And Telecommunications Research Institute | Apparatus and method of constructing user behavior pattern based on event log generated from context-aware system environment |
US20090271148A1 (en) * | 2008-04-25 | 2009-10-29 | Samsung Electronics Co., Ltd. | Cold-start in situation-aware systems |
Non-Patent Citations (1)
Title |
---|
See also references of EP2499844A4 * |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9800716B2 (en) | 2010-09-21 | 2017-10-24 | Cellepathy Inc. | Restricting mobile device usage |
US11070661B2 (en) | 2010-09-21 | 2021-07-20 | Cellepathy Inc. | Restricting mobile device usage |
US8750853B2 (en) | 2010-09-21 | 2014-06-10 | Cellepathy Ltd. | Sensor-based determination of user role, location, and/or state of one or more in-vehicle mobile devices and enforcement of usage thereof |
US10028113B2 (en) | 2010-09-21 | 2018-07-17 | Cellepathy Inc. | Device control based on number of vehicle occupants |
CN104094287A (en) * | 2011-12-21 | 2014-10-08 | 诺基亚公司 | A method, an apparatus and a computer software for context recognition |
EP2795538A4 (en) * | 2011-12-21 | 2016-01-27 | Nokia Technologies Oy | A method, an apparatus and a computer software for context recognition |
EP2815592A4 (en) * | 2012-02-15 | 2015-09-02 | Flybits Inc | Zone oriented systems |
US9312713B2 (en) | 2012-03-20 | 2016-04-12 | Sensirion Ag | Heating a sensitive layer of a chemical sensor subject to detection of a recharge process in an electronic device |
WO2013167190A1 (en) * | 2012-05-10 | 2013-11-14 | Telefonaktiebolaget L M Ericsson (Publ) | A method and apparatus to adapt the data traffic of a communication between a user equipment and a communication network |
US9801186B2 (en) | 2012-05-10 | 2017-10-24 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and apparatus to adapt the data traffic of a communication between a user equipment and a communication network |
US9691115B2 (en) | 2012-06-21 | 2017-06-27 | Cellepathy Inc. | Context determination using access points in transportation and other scenarios |
US9986084B2 (en) | 2012-06-21 | 2018-05-29 | Cellepathy Inc. | Context-based mobility stoppage characterization |
WO2013190380A3 (en) * | 2012-06-21 | 2014-05-15 | Cellepathy Ltd. | Device context determination |
US9772317B2 (en) | 2012-07-26 | 2017-09-26 | Sensirion Ag | Method for operating a portable electronic device |
WO2014055376A3 (en) * | 2012-10-04 | 2014-06-26 | Bjontegard Bernt Erik | Contextually intelligent communication systems and processes |
US10659594B2 (en) | 2015-02-12 | 2020-05-19 | American University Of Beirut | Context aware mobile personalization system and methods of use |
Also Published As
Publication number | Publication date |
---|---|
FI20096172A (en) | 2011-05-12 |
FI20096172A0 (en) | 2009-11-11 |
EP2499844A4 (en) | 2017-06-21 |
EP2499844B1 (en) | 2020-03-25 |
US20120271913A1 (en) | 2012-10-25 |
EP2499844A1 (en) | 2012-09-19 |
FI122770B (en) | 2012-06-29 |
US8990384B2 (en) | 2015-03-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2499844B1 (en) | A mobile device controlled by context awareness | |
US20190230210A1 (en) | Context recognition in mobile devices | |
CN102257511B (en) | Method, apparatus and computer program product for providing adaptive gesture analysis | |
EP2208370B1 (en) | Activating applications based on accelerometer data | |
CN112417439A (en) | Account detection method, device, server and storage medium | |
WO2018233438A1 (en) | Human face feature point tracking method, device, storage medium and apparatus | |
EP3525524B1 (en) | Determination of device body location | |
US8953039B2 (en) | System and method for auto-commissioning an intelligent video system | |
CN112857669B (en) | Fault detection method, device and equipment of pressure sensor and storage medium | |
CN105653171A (en) | Fingerprint identification based terminal control method, terminal control apparatus and terminal | |
CN110532895B (en) | Method, device and equipment for detecting fraudulent behavior in face recognition process | |
CN111476059A (en) | Target detection method and device, computer equipment and storage medium | |
JP2010016444A (en) | Situation recognizing apparatus, situation recognizing method, and radio terminal apparatus | |
CN111353346A (en) | Action recognition method, device, system, electronic equipment and storage medium | |
JP7256390B2 (en) | Analytical object acquisition device, analysis object acquisition method, and analysis object acquisition program | |
US20160124521A1 (en) | Remote customization of sensor system performance | |
JP6676217B2 (en) | Stress estimation system | |
EP3752793B1 (en) | Apparatus and method for estimating a physical state of a movable object | |
KR101882789B1 (en) | Method for calculating activity accuracy of conntextness service | |
CN112989342A (en) | Malicious software detection network optimization method and device, electronic equipment and storage medium | |
CN107229450A (en) | The method and terminal of a kind of terminal operation | |
KR101881443B1 (en) | Method for calculating route accuracy of conntextness service | |
WO2019176736A1 (en) | Display data generating device and program | |
CN117763371A (en) | Associated user prediction method and device for equipment behavior event | |
CN116089827A (en) | Industrial sensor data anomaly detection method, device and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10829574 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010829574 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13509298 Country of ref document: US |