CN110455027A - A kind of image collecting device and its refrigerator, control method - Google Patents

A kind of image collecting device and its refrigerator, control method Download PDF

Info

Publication number
CN110455027A
CN110455027A CN201910642155.8A CN201910642155A CN110455027A CN 110455027 A CN110455027 A CN 110455027A CN 201910642155 A CN201910642155 A CN 201910642155A CN 110455027 A CN110455027 A CN 110455027A
Authority
CN
China
Prior art keywords
reflecting mirror
depth camera
shell
camera
collecting device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910642155.8A
Other languages
Chinese (zh)
Inventor
曲磊
刘明
赵启东
高桢
李正义
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Group Co Ltd
Original Assignee
Hisense Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Group Co Ltd filed Critical Hisense Group Co Ltd
Priority to CN201910642155.8A priority Critical patent/CN110455027A/en
Publication of CN110455027A publication Critical patent/CN110455027A/en
Pending legal-status Critical Current

Links

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D11/00Self-contained movable devices, e.g. domestic refrigerators
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D23/00General constructional features
    • F25D23/12Arrangements of compartments additional to cooling compartments; Combinations of refrigerators with other equipment, e.g. stove
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/003Arrangement or mounting of control or safety devices for movable devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/005Mounting of control devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00Problems to be solved
    • F25D2500/06Stock management

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The present invention discloses a kind of image collecting device and its refrigerator, control method, is related to image acquisition technology, for solve current refrigerator acquire food materials information there are image recognition rates it is low, be difficult to obtain food materials location information and invent.Described image acquisition device includes the image collection assembly for being set to the top surface of refrigerator body, and described image acquisition component is slidably connected with the cabinet by sliding equipment, and described image acquisition component is slided from driving mechanisms control and slided to the front side of the cabinet;Described image acquisition component includes color camera and depth camera, when the form of the color camera and the depth camera is stretched out by the top surface of the cabinet, the color camera is used to shoot the food materials appearance picture in access procedure, and the depth camera is used to obtain the range information of the food materials in access procedure.Image collecting device of the invention is used for refrigerator.

Description

A kind of image collecting device and its refrigerator, control method
Technical field
The present invention relates to image acquisition technology more particularly to a kind of image collecting devices and its refrigerator, control method.
Background technique
In today's society, artificial intelligence technology in field of household appliances using more and more extensive.Refrigerator is as household electric appliances In common product, intelligent development has become one of direction of present convergence.And the intelligence of refrigerator is mainly reflected in pair The information of the different food materials of storage identifies.
Current refrigerator is usually to install color camera in refrigerator inside, and the mode for acquiring image, which is divided into access food materials, to be terminated Two class of dynamic acquisition in static acquisition and access procedure afterwards.
But camera is mounted on refrigerator inside, camera is only capable of identifying the corresponding indoor food materials information of storage, if each It is respectively mounted color camera in a storeroom, then can improve cost;And that there is also image recognition rates is low for color camera, is difficult to obtain The drawbacks such as distance and location information.
Summary of the invention
The embodiment of the present invention provides a kind of image collecting device and refrigerator, control method, can be to the multiple storages of refrigerator The food materials for hiding room carry out information identification, and can obtain the location information of food materials.
In order to achieve the above objectives, the embodiment of the present invention adopts the following technical scheme that
One aspect of the present invention embodiment provides a kind of image collecting device, the image of the top surface including being set to refrigerator body Acquisition component, described image acquisition component are slidably connected with the cabinet by sliding equipment, and described image acquisition component is by driving Dynamic mechanism controls sliding is simultaneously slided to the front side of the cabinet;
Described image acquisition component includes color camera and depth camera, when the color camera and the depth camera When form is stretched out by the top surface of the cabinet, the color camera is used to shoot the food materials appearance picture in access procedure, described Depth camera is used to obtain the distance between food materials and the depth camera in access procedure information.
Image collecting device provided in an embodiment of the present invention, image collection assembly is set on the top surface of cabinet and Be slidably connected with cabinet by sliding equipment, image collection assembly drives its sliding by driving mechanism, image collection assembly by Depth camera and color camera are constituted, and when image collection assembly stretches out, i.e., color camera and depth camera are in box top Then the outside at edge carries out dynamic acquisition to the food materials in access procedure, the appearance images of food materials are obtained by color camera, And the range information of food materials is obtained by depth camera, and the location information that food materials are placed is learnt by the distance, due to figure As acquisition component is mounted on refrigerator top surface, therefore, information collection can be carried out to the food materials in each storeroom of lower section, It is not required to that excessive camera is installed, reduces overall cost.
Another aspect of the present invention embodiment additionally provides a kind of refrigerator, including described in cabinet and any technical solution as above Image collecting device, described image acquisition device are set on the top surface of the cabinet.
Refrigerator provided in an embodiment of the present invention, as including image collecting device described in any of the above-described technical solution, because This, is able to solve identical technical problem, obtains identical technical effect.
Another aspect of the present invention embodiment additionally provides a kind of control method of image collecting device, comprising the following steps:
Refrigerator door is detected to open;In response to the opening of refrigerator door, the driving mechanism pushes described image acquisition group Part is slided to the front side of refrigerator body;The side of the top surface of the cabinet is stretched out in response to the form in described image acquisition component Edge controls the food materials appearance picture in the color camera shooting access procedure in described image acquisition component, the depth Camera obtains the range information of the food materials in access procedure.
The control method of image processing apparatus provided in an embodiment of the present invention, with the opening and closing of door body or user's language Sound instruction is used as signal, and control driving mechanism operation makes image collection assembly be pushed out or withdraw, when release, to accessed Food materials in journey carry out appearance picture and location information acquisition, and when withdrawal, image collection assembly is closed, thus to Image Acquisition group Part forms protection, prolongs the service life.
Detailed description of the invention
Fig. 1 is refrigerator main view provided in an embodiment of the present invention;
Fig. 2 is refrigerator side view provided in an embodiment of the present invention (image collection assembly retracted state);
Fig. 3 is refrigerator side view provided in an embodiment of the present invention (image collection assembly release state);
Fig. 4 is the structural schematic diagram of the image collection assembly slide construction on refrigerator top surface provided in an embodiment of the present invention;
Fig. 5 is the interior of shell structural schematic diagram of image collection assembly provided in an embodiment of the present invention;
Fig. 6 is the interior of shell and box structure diagram of image collection assembly provided in an embodiment of the present invention;
Fig. 7 is image collection assembly system architecture diagram provided in an embodiment of the present invention (communication unit uses USB unit);
Fig. 8 be image collection assembly system architecture diagram provided in an embodiment of the present invention (communication unit using WIFI unit or Cable network unit);
Fig. 9 is enclosure bottom structural schematic diagram provided in an embodiment of the present invention (speaker openings are located on the bottom surface);
Figure 10 is enclosure bottom structural schematic diagram provided in an embodiment of the present invention (speaker openings are located in shell side);
Figure 11 is the light path schematic diagram of depth camera provided in an embodiment of the present invention;
Figure 12 is the first reflecting mirror of depth camera provided in an embodiment of the present invention and the installation site knot of the second reflecting mirror Structure schematic diagram;
Figure 13 is the second reflecting mirror of depth camera provided in an embodiment of the present invention and the installation site structure of depth camera Schematic diagram;
Figure 14 is the control method flow chart of image collecting device provided in an embodiment of the present invention.
Appended drawing reference: 1, cabinet;11, support;12, slide plate;13, driving mechanism;14, image collection assembly;140, shell; 1401, color camera form;1402, depth camera form;1403, speaker openings;1404, microphone aperture;141, colored phase Machine;142, depth camera;143, the first reflecting mirror;144, the second reflecting mirror;145, speech processor;146, microphone;147, Loudspeaker;148, communication unit;149, application processor;150, central processing module;15, sliding rail;16, sliding block;17, mirror image is deep Spend camera;2, door body;
Specific embodiment
A kind of image collecting device provided in an embodiment of the present invention and refrigerator, control method are carried out with reference to the accompanying drawing Detailed description.
In the description of the present invention, it is to be understood that, term " center ", "upper", "lower",
The orientation or position of the instructions such as "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outside" Setting relationship is to be based on the orientation or positional relationship shown in the drawings, and is merely for convenience of description of the present invention and simplification of the description, rather than The device or element of indication or suggestion meaning must have a particular orientation, be constructed and operated in a specific orientation, therefore cannot It is interpreted as limitation of the present invention.
Term " first ", " second " be used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance or Implicitly indicate the quantity of indicated technical characteristic." first " is defined as a result, the feature of " second " can be expressed or imply Ground includes one or more of the features.In the description of the present invention, unless otherwise indicated, the meaning of " plurality " is two or It is more than two.
In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, term " installation ", " phase Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected;It can To be to be connected directly, the connection inside two elements can also be can be indirectly connected through an intermediary.For this field For those of ordinary skill, the concrete meaning of above-mentioned term in the present invention can be understood with concrete condition.
A kind of image collecting device provided in an embodiment of the present invention as shown in Figure 1, Figure 2, Figure 4 shows, including is set to refrigerator case The image collection assembly 14 of the top surface of body 1, image collection assembly 14 are slidably connected with cabinet 1 by sliding equipment, Image Acquisition Component 14 is controlled by driving mechanism 13 and is slided, and image collection assembly 14 slides in the horizontal direction, to the front side of cabinet;Image Acquisition Component 14 is as shown in Fig. 4, Fig. 5, Fig. 6, including color camera 141 and depth camera 142, when color camera 141 and depth camera When 142 form is stretched out by the top surface of cabinet 1, color camera 141 is used to acquire the color image letter of the food materials in access procedure Breath, depth camera 142 are used to acquire the range information of the food materials in access procedure.
Image collection assembly 14 is set on the top surface of cabinet 1, simultaneously by image collecting device provided in an embodiment of the present invention And be slidably connected with cabinet 1 by sliding equipment, image collection assembly 14 drives its sliding, Image Acquisition by driving mechanism 13 Component 14 is made of depth camera 142 and color camera 141, when image collection assembly 14 stretches out, i.e. color camera 141 and deep Degree camera 142 is on the outside of 1 top surface edge of cabinet, is then carried out dynamic acquisition to the food materials in access procedure, is passed through colored phase Machine 141 obtains the appearance images of food materials, and the range information of food materials is obtained by depth camera 142, and obtain by the distance Know the location information that food materials are placed, since image collection assembly 14 is mounted on refrigerator top surface, each storage to lower section Food materials in hiding room can carry out information collection, do not install excessive camera, reduce overall cost.
Preferably, using common general camera on the market, depth camera can be used at present on the market color camera Based on the depth cameras of principles such as TOF (Time of flight, time-of-flight method 3D imaging), structure light, binocular or other It can be realized other cameras of the distance measurement function.
Sliding equipment provided in an embodiment of the present invention includes the support 11 for being set to the top surface of cabinet 1, is arranged on support 11 There is sliding rail 15, as shown in figure 4, slidably connecting sliding block 16 on sliding rail 15, slide plate 12 is provided on sliding block 16, driving mechanism 13 is driven Dynamic slide plate 12 and sliding block 16 are slided along sliding rail 15, and image collection assembly 14 is set on slide plate 12.Above-mentioned sliding equipment is using cunning Sliding rail 15 is set between plate 12 and support 11 and the realization of sliding block 16 is slidably connected, to make image collection assembly 14 along sliding rail 15 Then setting direction sliding is used as power by driving mechanism 13, driving image collection assembly 14 is released or withdrawn, to realize The automation control of image collection assembly 14.
Driving mechanism 13 in the embodiment of the present invention can add drive mechanism or the rotation of rack-and-pinion using rotating electric machine Rotating motor adds the drive mechanism of ball-screw to drive slide plate 12 to slide, and keeps the components such as slide plate 12 and rack gear or feed screw nut solid Fixed connection can also use following scheme, as shown in figure 4, driving mechanism 13 is linear motor, the push rod of linear motor with Slide plate 12 connects.Compared to the technical solution that rotating electric machine plus rack-and-pinion or rotating electric machine add ball-screw, linear motor Have many advantages, such as that structure is simple, volume and weight is small, and its push rod is directly connect by linear motor with slide plate 12, and centre is not required to Other transmission parts are wanted, therefore positioning accuracy is higher.
Image collection assembly 14 provided in an embodiment of the present invention further includes shell 140 as shown in Fig. 7, Fig. 9, and form includes It is set on the bottom surface of shell 140 and is provided with color camera form 1401 and depth camera form 1402, color camera 141 and depth Degree camera 142 is all set in interior of shell, and color camera form 1401 is corresponding with 141 position of color camera, depth camera form 1402 is corresponding with 142 position of depth camera;Speech processor 145, microphone 146, loudspeaker are additionally provided with inside shell 140 147 and communication unit 148, the signal output end of speech processor 145 connect with loudspeaker 147, the signal of microphone 146 is defeated Enter end to connect with speech processor 145, depth camera 142, color camera 141 and speech processor 145 pass through communication unit 148 are communicated with central processing module 150.User can carry out voice input food materials information by microphone 146, and lead to Cross the food of food materials information and food materials storage location information and user speech typing that color camera 141 and depth camera 142 acquire Material information is uploaded to central processing module 150 by communication unit, by central processing module 150 to the letter of user speech typing The information that breath and color camera 141 and depth camera 142 acquire is compared, error correction, and comparison result is then passed through loudspeaking Device 147 plays, it is ensured that the accuracy of the food materials information of acquisition.
It should be pointed out that above-mentioned central processing module 150 is that it is whole to be responsible for refrigerator with the high central processing unit for calculating power The business logic processing and network model of body calculate, and the equipment with the function is used equally in the scheme of the application.
Below by taking tomato as an example, above system is described in detail, when accessing tomato, when opening refrigerator doors When, image collection assembly stretches out, and so that depth camera 142 and color camera 141 is moved to the outside at refrigerator top surface edge, then User places tomato into refrigerator, and when the hand that user holds tomato stretches to refrigerator inside, color camera 141 acquires western red The color image of persimmon, depth camera 142 acquire range information of the tomato apart from depth camera 142, color image and apart from letter Breath is sent to central processing module 150 by communication unit 148, central processing module 150 by the color image received and Range information is handled, and identifies that food materials type is the accessing operation of " tomato " and food materials, access site etc. Reason as a result, and processing result be sent to speech processor 145, speech processor 145 plays to user by loudspeaker 147 It listens, for example, " storage food materials tomato, deposit in refrigerating chamber third layer ", then user is confirmed or corrected by microphone and raised The processing result that sound device 147 plays, and the voice messaging that speech processor 145 will confirm that or correct passes through communication unit 148 are sent to central processing module 150, and voice messaging is compared with processing result image again for central processing module 150, Then the result for confirming after comparison or correcting user is played to by loudspeaker 147 to listen.
In addition, the food materials that user can also be stored in by 146 typing of microphone are the placement position of " tomato " and food materials Equal voice messagings are set, voice messaging is sent to speech processor 145, and speech processor 145 is believed voice by communication unit 148 Breath is sent to central processing module 150, and central processing module 150 is by the voice messaging received and color image and apart from letter Breath is compared, and comparison result is then sent to speech processor 145 by communication unit, speech processor 145 is by raising Comparison result is played to user and listened by sound device 147, then user's closing refrigerator door, and image collection assembly is withdrawn, that is, is completed western red The storage process of persimmon.Conversely, the motor message transmission of image collection assembly is identical when taking out tomato, Gu it is no longer superfluous It states.
In some embodiments, color camera form 1401 and color camera 141 are to the corresponding figure for referring to color camera 141 As acquisition elements can carry out Image Acquisition through color camera form 1401.
In some embodiments, depth camera form 1402 is corresponding with 142 position of depth camera refers to that depth camera 142 can Image Acquisition is carried out with penetratingdepth camera view 1402.
Preferably, as shown in fig. 7, communication unit 148 is using the USB interface being set on shell 140.User can pass through Image collection assembly is connect by USB interface with local terminal, carries out comparison, the error correction of information.
Preferably, as shown in figure 8, communication unit 148 uses WIFI network or cable network.Depth camera 142, colored phase Data will be packaged by machine 141, the data that microphone 146 acquires by application processor 149, then pass through WIFI network or have Limit network is connect with cloud server, carries out comparison, the error correction of information.
Shell 140 provided in an embodiment of the present invention further includes and bottom surface is connect towards the leading flank on front side of refrigerator, shell Speaker openings 1403 and microphone aperture 1404 are additionally provided on 140 bottom surface, as shown in Fig. 7, Fig. 9, speaker openings 1403 Loudspeaker 147 is arranged in place, microphone 146 is arranged at microphone aperture 1404, it should be pointed out that the speaker openings 1403 and wheat The setting position of gram air holes 1404 is not unique, speaker openings 1403 and microphone aperture 1404 can be arranged at shell 140 On towards on the side in 2 direction of door body, so when users use, microphone 146 and loudspeaker 147 are closer apart from user, Can preferably typing voice messaging and hear voice messaging broadcast;It can also will be by speaker openings 1403, microphone aperture 1404 and color camera form 1401 be all set on 140 bottom surface of shell close to leading flank edge, color camera form 1401 are set between speaker openings 1403 and microphone aperture 1404.Compared to being set to towards the side on the side of refrigerator doors Case, the scheme being set on bottom surface make user be not readily apparent speaker openings 1403 and microphone aperture 1404, and its distance User is still close, does not influence user's typing voice and hearing voice casting, can be to 147 shape of microphone 146 and loudspeaker At protection.And be set to color camera form 1401 therebetween, so that color camera form 1401 is in medium position Enough 1 regions of uniform fold refrigerator body, it is accurate to obtain food materials image information.
Further, microphone 146 provided in an embodiment of the present invention uses 146 array of microphone, when the microphone 146 When longer, then can occupy biggish position on 140 bottom surface of shell, therefore, as shown in figure 7 and figure 10, color camera form 1401 with Speaker openings 1403 are required to deviate to the direction far from microphone aperture 1404, due between microphone 146 and loudspeaker 147 Distance at least to meet voice remove dryness, the requirement of echo cancellor scheduling algorithm, so, at this time can be by microphone aperture 1404 and coloured silk Color camera view 1401 is set to the edge on the bottom surface of shell 140 close to refrigerator doors, and speaker openings 1403 can be set It is placed on side wall vertical with refrigerator doors on shell 140.
Depth camera 142 provided in an embodiment of the present invention, no matter using on the market based on originals such as TOF, structure light, binoculars Any depth camera 142 of reason, if the collection lens of depth camera are directly set up directly on depth camera form There is nearest detection range, generally more than ten centimetres are not due to acquiring visual angle in the plan-position where 1402 Deng i.e. depth camera 142 being capable of object other than more than ten centimetres of its focus of detection range, it is difficult to collect the depth of further distance Information is spent, while its conical region for acquiring visual angle covering is smaller, so that the time of detectable access action is shorter, realized pair The accurate tracking of access action, it is more demanding to the processing capacity of chip.Therefore, for make depth camera 142 it is effective detection away from Top layer space from covering refrigerator, needs depth camera 142 will be set up it is higher, i.e., it is enough from having at the top of refrigerator Height, can just evade blind area caused by nearest detection range, but if the setting of depth camera 142 is higher than refrigerator top surface ten Several centimetres, then making the excessive height of the entirety of shell 140, volume is excessive, and it is larger so as to cause occupied space, nor it is conducive to beauty It sees.
Therefore, as shown in Figure 4, Figure 5, in order to reduce the blind area of depth camera, while it is excessively high to avoid depth camera 142 from setting up The problem of causing is provided with the first reflecting mirror 143 laterally arranged and the second reflection in shell 140 provided in an embodiment of the present invention Mirror 144, the first reflecting mirror 143 and the second reflecting mirror 144 are obliquely installed in shell 140, and the first reflecting mirror 143 is set to Between two-mirror 144 and the leading flank of shell 140, the mirror surface of the first reflecting mirror 143 is opposite with the mirror surface of the second reflecting mirror 144 Setting;By the light that depth camera form 1402 is injected, is reflected by the first reflecting mirror 143 and reach the second reflecting mirror 144, instead It penetrates light and is reflected into depth camera 142 by the second reflecting mirror.
Specifically, as shown in figure 11, it is assumed that mirror depth camera 17, and the mirror image are provided with above shell 140 The distance of depth camera 17 to refrigerator top surface meets the nearest detection range of depth camera 142, and (nearest detection range refers to depth The nearest effective detection range of camera, depth camera can not obtain the depth information less than the distance), and the mirror image of the position The investigative range of depth camera 17 can effectively cover the storage compartment of refrigerator, and in optical instrument, field angle is bigger, optics instrument The angular field of view of device is bigger, i.e., investigative range is bigger, and field angle is using the focus of optical instrument as vertex, with measured target Image can constitute angle by two edges of the maximum magnitude of camera lens, therefore the field angle of the mirror depth camera 17 can be with Two light projected by A point are expressed as, A point is the focus of mirror depth camera 17, and setting first is anti-in shell 140 at this time Mirror 143 is penetrated, it is mirror image that two farthest vertex representations of distance, which are the angle that B and C, i.e. AB and AC are formed, on the first reflecting mirror 143 The field angle of depth camera 17, that is, maximum investigative range, when two light of AB and AC that mirror depth camera 17 issues When reflecting on the first reflecting mirror 143, reflection light can inject the second reflecting mirror 144, i.e. BB1And CC1, BB1And CC1For The maximum magnitude for all light that second reflecting mirror 144 can receive, then BB1And CC1After the reflection of the second reflecting mirror 144 Reflection light can generate an intersection point A1, A at this time1Position is the focal position of depth camera 142, since optical path is reversible , therefore, the investigative range of depth camera 142 is equivalent to the investigative range of mirror depth camera 17, and depth camera 142 is not It needs to be arranged excessively high, so that making the height of shell 140 reduces, increases overall aesthetics, and reduce occupied space.
First reflecting mirror 143 provided in an embodiment of the present invention can not be arranged in parallel with the second reflecting mirror 144, can also So that the first reflecting mirror 143 and the second reflecting mirror 144 are arranged in parallel.It is arranged in parallel compared to not parallel scheme Two mirror surfaces it is more convenient during installation, and be easier determine depth camera 142 installation site.
The investigative range of depth camera 142 provided in an embodiment of the present invention, as shown in figure 3, constituting the view of depth camera 142 Two edges of rink corner, such as the investigative range for the dotted line expression depth camera 142 that two do not intersect in Fig. 3, one is parallel to case The plane of 1 storeroom of body opening, another plane perpendicular to the opening, the intersection point that two dotted lines upwardly extend is above-mentioned mirror As visual field scope i.e. 0 °~90 ° that the focus of depth camera 17, two edges are constituted, as shown in figure 11, and the first reflection 143 need of mirror are mounted in the investigative range of depth camera 142, therefore, the bottom surface of the first reflecting mirror 143 and shell 140 Between the angle that is formed be α, and meet 0 ° of 90 ° of < α <.Since the first reflecting mirror 143 is parallel with the second reflecting mirror 144, Angle between second reflecting mirror 144 and the bottom surface of shell 140 similarly meets the range.
Preferably, as shown in figure 3, color camera 141 uses wide angle camera, if the dotted line of two intersections in Fig. 3 is colour The investigative range of camera 141.
Further, the angle between the first reflecting mirror 143 and shell 140 can change, therefore, the first reflecting mirror 143 installation site will affect the volume of shell 140, and as shown in figure 11, the first reflecting mirror 143 is needed in mirror depth camera In 17 investigative range, therefore angle α is bigger, then C point is higher, i.e. the first reflecting mirror 143 and the angle of 140 bottom surface of shell are got over Greatly, the height of shell 140 is higher, to meet the requirement that integrally occupies little space, then the first reflecting mirror 143 and 140 bottom surface of shell Angle it is the smaller the better, but its space layout of installation for needing to meet depth camera 142 and circuit structure in shell 140 It is required that.
The structure in addition, the second reflecting mirror 144 and the first reflecting mirror 143 are preferably parallel to each other, therefore, when the second reflecting mirror 144 with the timing of angle one of 140 bottom surface of shell, as shown in figure 11, the second reflecting mirror is bigger, then C1Bottom of the point apart from shell 140 Identity distance is higher so as to cause the setting height of depth camera 142 from bigger, and the second reflecting mirror 144 cannot at least block first The optical path of reflecting mirror 143, since the reflecting mirror storage the big more is conducive to process, the size of the second reflecting mirror 144 can phase It is larger to making, advantageously ensure that processing technology and assembly precision.
Since depth camera 142 is the food materials information detected downwards in access procedure by depth camera form 1402 , to prevent the investigative range of depth camera 142 to be greater than the size of depth camera form 1402, lead to the spy of depth camera 142 It surveys range to be blocked by 140 bottom surface of shell, therefore, the first reflecting mirror 143 provided in an embodiment of the present invention is on the bottom surface of shell 140 Projection be overlapped with depth camera form 1402 or projection of first reflecting mirror 143 on the bottom surface of shell 140 is less than depth Camera view 1402.Make the projection of the first reflecting mirror 143 that depth camera form is overlapped or be less than with depth camera form 1402 4102, to guarantee be reflected by the first reflecting mirror 143 by every incident light of depth camera form 1402, prevent depth The investigative range of degree camera 142 is blocked.
It should be pointed out that projection need to be in deep when the projection of the first reflecting mirror 143 is less than depth camera form 1402 It spends in the range of camera view 1402, to guarantee that the first reflecting mirror 143 can receive in 142 investigative range of depth camera Each light.
To prevent the second reflecting mirror 144 from blocking the incident ray of the first reflecting mirror 143, shell provided in an embodiment of the present invention 140 further include the trailing flank being oppositely arranged with leading flank, and the top surface being oppositely arranged with bottom surface, and the second reflecting mirror 144 is close The edge of the bottom surface of shell 140 is first distance at a distance from the projection on bottom surface is between trailing flank, and the first reflecting mirror 143 leans on The edge of the top surface of nearly shell 140 position second distance, first distance at a distance from the projection on bottom surface is between trailing flank are little In second distance.As shown in figure 12, by the B of the second reflecting mirror 1441The C point of point and the first reflecting mirror 143 is to after shell 140 Vertical line is done in side, and intersection point is respectively B2And C2, B1B2For above-mentioned first distance, CC2For above-mentioned second distance, two lines section needs to meet B1B2Less than or equal to CC2, i.e. projection and second reflecting mirror 144 of the first reflecting mirror 143 on 140 bottom surface of shell are in shell Projection on 140 bottom surfaces is not overlapped mutually, to guarantee that the two will not influence each other, is shut out the light, is avoided influence depth camera 142 investigative range.
Due to the field angle for the depth camera 142 recorded in foregoing teachings, wherein it is parallel to the opening of cabinet 1 on one side, because This, the edge of top surface of the second reflecting mirror 144 provided in an embodiment of the present invention close to shell 140 and the focus of depth camera 142 Constitute a plane, the plane perpendicular of the plane and shell 140.As shown in figure 13, from the focus of depth camera 142 to shell It is vertical line, intersection point A in 140 bottom surface2, which need to meet A1A2Have to pass through the C of the second reflecting mirror1Point, due to the first reflection Mirror 143 is parallel to each other with the second reflecting mirror 144, and depth camera 142 and the investigative range of mirror depth camera 17 are equivalent, because This, the critical ray AC of mirror depth camera 17 and the plane perpendicular of shell 140, the i.e. investigative range of depth camera 142 determine In the range of rotating 90 ° in the counterclockwise direction for vertical direction, keep the investigative range of depth camera 142 more accurate.
A kind of refrigerator provided in an embodiment of the present invention, including Image Acquisition described in cabinet 1 and any of the above-described technical solution Device, image collecting device are set on the top surface of cabinet 1.Since refrigerator includes the image collecting device of above-mentioned technical proposal, Therefore, it is able to solve identical technical problem, obtains identical technical effect.
A kind of control method of image collecting device provided in an embodiment of the present invention, includes the following steps, this method process Figure is as shown in figure 14: detection refrigerator door 2 is opened;In response to the opening of refrigerator door 2, the driving mechanism 13 pushes the figure As acquisition component 14 is slided to the front side of refrigerator body 1;The case is stretched out in response to the form in described image acquisition component 14 The edge of the top surface of body 1 controls the food materials in the shooting access procedure of the color camera 141 in described image acquisition component 14 Appearance picture, the depth camera 142 obtain the range information of the food materials in access procedure.
The control method of image processing apparatus provided in an embodiment of the present invention, using the opening and closing of door body 2 as signal, Control driving mechanism 13 to run, image collection assembly 14 made to be pushed out or withdraw, when release, to the food materials in access procedure into Row information acquisition, when withdrawal, image collection assembly 14 is closed, and is protected to be formed to image collection assembly 14, is extended and is used the longevity Life.
Closer, detection refrigerator door 2 is closed;In response to the closing of the door body 2, the driving mechanism 13 is pushed 14 reverse slide of described image acquisition component is to return to initial position;In response to the form in described image acquisition component 14 by institute The edge for stating 1 top surface of cabinet blocks, and controls the color camera 141 and the depth camera 142 is closed.
It should be pointed out that above-mentioned switch gate signal is obtained by switch sensor in the prior art, such as it is attracted magnetic Iron class, Hall sensor class, mechanical switch etc. or other can be realized the element of the function.
Preferably, image collection assembly 14 can receive the phonetic order of user, and control driving mechanism 13 push or Slide plate 12 is pulled to slide.User can send phonetic order by microphone 146, to realize that multiple control modes control image Acquisition component 14 is released or is withdrawn, and keeps the control mode of image collection assembly 14 more flexible.
In the description of this specification, particular features, structures, materials, or characteristics can be real in any one or more Applying can be combined in any suitable manner in example or example.
More than, only a specific embodiment of the invention, but scope of protection of the present invention is not limited thereto, and it is any to be familiar with Those skilled in the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all cover Within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (14)

1. a kind of image collecting device, which is characterized in that the image collection assembly including being set to the top surface of refrigerator body, it is described Image collection assembly is slidably connected with the cabinet by sliding equipment, and described image acquisition component is slided by driving mechanisms control And it is slided to the front side of the cabinet;
Described image acquisition component includes color camera and depth camera, when the form of the color camera and the depth camera After being stretched out by the top surface of the cabinet, the color camera is used to shoot the appearance picture of the food materials in access procedure, the depth Degree camera is used to obtain the range information of the food materials in access procedure.
2. image collecting device according to claim 1, which is characterized in that the sliding equipment includes being set to the case The support of the top surface of body is provided with sliding rail on the support, sliding block is slidably connected on the sliding rail, is provided on the sliding block Slide plate, the driving mechanism drive the slide plate and sliding block to slide along the sliding rail, and described image acquisition component is set to described On slide plate.
3. image collecting device according to claim 2, which is characterized in that the driving mechanism is linear motor, described The push rod of linear motor is connect with the slide plate.
4. image collecting device according to claim 1, which is characterized in that described image acquisition component further includes shell, The form includes that color camera form and depth camera form are provided on the bottom surface for be set to the shell, the colour phase Machine and the depth camera are all set in the interior of shell, and the color camera form is corresponding with the color camera position, The depth camera form is corresponding with the depth camera position;
The interior of shell is additionally provided with speech processor, microphone, loudspeaker and communication unit, the speech processor Signal output end is connect with the loudspeaker, and the signal input part of the microphone is connect with the speech processor, the depth Degree camera, color camera and speech processor pass through the communication unit and are communicated with terminal device.
5. image collecting device according to claim 4, which is characterized in that the shell further includes connecting with the bottom surface Towards the leading flank on front side of refrigerator, be additionally provided with speaker openings and microphone aperture, the loudspeaking on the bottom surface of the shell The loudspeaker is arranged in device opening, the setting microphone at the microphone aperture, the speaker openings, microphone aperture and Color camera form is all set in the edge on the enclosure bottom close to the leading flank, the color camera form setting Between the speaker openings and the microphone aperture.
6. image collecting device according to claim 4, which is characterized in that be provided in the shell the first reflecting mirror and Second reflecting mirror, first reflecting mirror and the second reflecting mirror are obliquely installed in the shell, and first reflecting mirror is set It is placed between second reflecting mirror and the leading flank, the mirror surface of the mirror surface of first reflecting mirror and second reflecting mirror It is oppositely arranged;Second reflecting mirror is reached by reflection by the light that depth camera form injects first reflecting mirror, Reflection light is reflected into the depth camera by second reflecting mirror.
7. image collecting device according to claim 6, which is characterized in that first reflecting mirror and second reflection Mirror is arranged in parallel.
8. image collecting device according to claim 7, which is characterized in that the bottom of first reflecting mirror and the shell The angle formed between face is α, and meets 0 ° of 90 ° of < α <.
9. image collecting device according to claim 7, which is characterized in that first reflecting mirror is at the bottom of the shell Projection on face is overlapped with the depth camera form or projection of first reflecting mirror on the bottom surface of the shell is located at In the depth camera window and it is less than the depth camera form.
10. image collecting device according to claim 9, which is characterized in that the shell further includes and the leading flank The trailing flank being oppositely arranged, and the top surface being oppositely arranged with the bottom surface, side of second reflecting mirror close to the bottom surface Along being first distance at a distance from the projection on the bottom surface is between the trailing flank, first reflecting mirror is close to the top The edge in face is second distance at a distance from the projection on the bottom surface is between the trailing flank, and the first distance is not more than The second distance.
11. image collecting device according to claim 9, which is characterized in that second reflecting mirror is close to the top surface Edge and the depth camera focus constitute a plane, the plane perpendicular of the plane and the shell.
12. a kind of refrigerator, which is characterized in that including cabinet and the described in any item image collecting devices of claim 1-11, institute Image collecting device is stated to be set on the top surface of the cabinet.
13. a kind of control method of image collecting device, which comprises the following steps:
Refrigerator door is detected to open;In response to the opening of refrigerator door, the driving mechanism push described image acquisition component to It slides the front side of refrigerator body;The edge of the top surface of the cabinet is stretched out in response to the form in described image acquisition component, is controlled The food materials appearance picture in color camera shooting access procedure in described image acquisition component processed, the depth camera obtain Take the range information of the food materials in access procedure.
14. the control method of image collecting device according to claim 13, which is characterized in that detection refrigerator door closes It closes;In response to the closing of the door body, the driving mechanism pushes described image acquisition component reverse slide to return to initial bit It sets;Blocked in response to the form in described image acquisition component by the edge of the box top, control the color camera and The depth camera is closed.
CN201910642155.8A 2019-07-16 2019-07-16 A kind of image collecting device and its refrigerator, control method Pending CN110455027A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910642155.8A CN110455027A (en) 2019-07-16 2019-07-16 A kind of image collecting device and its refrigerator, control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910642155.8A CN110455027A (en) 2019-07-16 2019-07-16 A kind of image collecting device and its refrigerator, control method

Publications (1)

Publication Number Publication Date
CN110455027A true CN110455027A (en) 2019-11-15

Family

ID=68481286

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910642155.8A Pending CN110455027A (en) 2019-07-16 2019-07-16 A kind of image collecting device and its refrigerator, control method

Country Status (1)

Country Link
CN (1) CN110455027A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111473589A (en) * 2020-04-23 2020-07-31 海信集团有限公司 Intelligent refrigerator and cross-media interaction method
CN111931638A (en) * 2020-08-07 2020-11-13 华南理工大学 Local complex area positioning system and method based on pedestrian re-identification
CN113124635A (en) * 2019-12-31 2021-07-16 海信集团有限公司 Refrigerator with a door
CN113124636A (en) * 2019-12-31 2021-07-16 海信集团有限公司 Refrigerator with a door
CN113139402A (en) * 2020-01-17 2021-07-20 海信集团有限公司 A kind of refrigerator
CN113158876A (en) * 2021-04-16 2021-07-23 青岛海尔电冰箱有限公司 Method for identifying information of articles in refrigerator, refrigerator and computer storage medium
CN113465252A (en) * 2020-05-29 2021-10-01 海信集团有限公司 Intelligent refrigerator and drawer state detection method in intelligent refrigerator
CN113496245A (en) * 2020-06-23 2021-10-12 青岛海信电子产业控股股份有限公司 Intelligent refrigerator and method for identifying food material storing and taking
WO2021250913A1 (en) * 2020-06-09 2021-12-16 日立グローバルライフソリューションズ株式会社 Refrigerator and output device
CN113810577A (en) * 2021-09-13 2021-12-17 张元本 External camera system and application thereof
WO2022048564A1 (en) * 2020-09-03 2022-03-10 海尔智家股份有限公司 Refrigeration appliance having movable camera
CN115143722A (en) * 2021-03-31 2022-10-04 青岛海尔电冰箱有限公司 Control method of refrigerating device
CN116182463A (en) * 2021-11-25 2023-05-30 海信集团控股股份有限公司 Detection equipment, refrigerator and method for identifying access behaviors of user to food materials in refrigerator
JP7453133B2 (en) 2020-12-15 2024-03-19 日立グローバルライフソリューションズ株式会社 Storage, storage system and image recognition method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102032740A (en) * 2009-09-29 2011-04-27 北京爱国者存储科技有限责任公司 Refrigerator
CN206583440U (en) * 2017-03-09 2017-10-24 长春华懋科技有限公司 A kind of projected image sighting distance detecting system
CN107959773A (en) * 2016-10-18 2018-04-24 三星电子株式会社 The electronic device of shooting image
US20180174584A1 (en) * 2016-12-16 2018-06-21 Chiun Mai Communication Systems, Inc. Voice control device, system, and method thereof
WO2018142136A1 (en) * 2017-01-31 2018-08-09 Smarter Applications Limited Imaging apparatus
CN208299897U (en) * 2018-06-12 2018-12-28 链家网(北京)科技有限公司 A kind of depth camera
CN109631456A (en) * 2017-10-06 2019-04-16 东芝生活电器株式会社 Refrigerator

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102032740A (en) * 2009-09-29 2011-04-27 北京爱国者存储科技有限责任公司 Refrigerator
CN107959773A (en) * 2016-10-18 2018-04-24 三星电子株式会社 The electronic device of shooting image
US20180174584A1 (en) * 2016-12-16 2018-06-21 Chiun Mai Communication Systems, Inc. Voice control device, system, and method thereof
WO2018142136A1 (en) * 2017-01-31 2018-08-09 Smarter Applications Limited Imaging apparatus
CN206583440U (en) * 2017-03-09 2017-10-24 长春华懋科技有限公司 A kind of projected image sighting distance detecting system
CN109631456A (en) * 2017-10-06 2019-04-16 东芝生活电器株式会社 Refrigerator
CN208299897U (en) * 2018-06-12 2018-12-28 链家网(北京)科技有限公司 A kind of depth camera

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113124635A (en) * 2019-12-31 2021-07-16 海信集团有限公司 Refrigerator with a door
CN113124636B (en) * 2019-12-31 2022-05-24 海信集团有限公司 Refrigerator
CN113124636A (en) * 2019-12-31 2021-07-16 海信集团有限公司 Refrigerator with a door
CN113139402B (en) * 2020-01-17 2023-01-20 海信集团有限公司 A kind of refrigerator
CN113139402A (en) * 2020-01-17 2021-07-20 海信集团有限公司 A kind of refrigerator
CN111473589B (en) * 2020-04-23 2021-06-01 海信集团有限公司 Intelligent refrigerator and cross-media interaction method
CN111473589A (en) * 2020-04-23 2020-07-31 海信集团有限公司 Intelligent refrigerator and cross-media interaction method
CN113465252A (en) * 2020-05-29 2021-10-01 海信集团有限公司 Intelligent refrigerator and drawer state detection method in intelligent refrigerator
JP7500285B2 (en) 2020-06-09 2024-06-17 日立グローバルライフソリューションズ株式会社 Refrigerators and output devices
WO2021250913A1 (en) * 2020-06-09 2021-12-16 日立グローバルライフソリューションズ株式会社 Refrigerator and output device
CN113496245A (en) * 2020-06-23 2021-10-12 青岛海信电子产业控股股份有限公司 Intelligent refrigerator and method for identifying food material storing and taking
CN111931638A (en) * 2020-08-07 2020-11-13 华南理工大学 Local complex area positioning system and method based on pedestrian re-identification
CN111931638B (en) * 2020-08-07 2023-06-20 华南理工大学 Pedestrian re-identification-based local complex area positioning system and method
WO2022048564A1 (en) * 2020-09-03 2022-03-10 海尔智家股份有限公司 Refrigeration appliance having movable camera
US11512896B2 (en) 2020-09-03 2022-11-29 Haier Us Appliance Solutions, Inc. Refrigerator appliance having a movable camera
JP7453133B2 (en) 2020-12-15 2024-03-19 日立グローバルライフソリューションズ株式会社 Storage, storage system and image recognition method
CN115143722A (en) * 2021-03-31 2022-10-04 青岛海尔电冰箱有限公司 Control method of refrigerating device
CN115143722B (en) * 2021-03-31 2023-10-24 青岛海尔电冰箱有限公司 Control method of refrigerating device
CN113158876A (en) * 2021-04-16 2021-07-23 青岛海尔电冰箱有限公司 Method for identifying information of articles in refrigerator, refrigerator and computer storage medium
CN113810577A (en) * 2021-09-13 2021-12-17 张元本 External camera system and application thereof
CN116182463A (en) * 2021-11-25 2023-05-30 海信集团控股股份有限公司 Detection equipment, refrigerator and method for identifying access behaviors of user to food materials in refrigerator

Similar Documents

Publication Publication Date Title
CN110455027A (en) A kind of image collecting device and its refrigerator, control method
US11630214B2 (en) System and method of capturing and generating panoramic three-dimensional images
EP2998671B1 (en) Refrigerator and control method for the same
EP2995892B1 (en) Refrigerator
CN103901901B (en) A kind of screen rotation method and device of video terminal
CN109460074B (en) Directional display method and device for audio equipment and audio equipment
CN106346487A (en) Interactive VR sand table show robot
CN102131047A (en) 360-degree automatic tracking hunting camera and working method thereof
CN106695849A (en) Sensing, controlling and performing system for greeting security service robot
CN104125378A (en) Method, lens assembly, camera, system and use for reducing stray light
WO2017004945A1 (en) Shooting terminal and shooting method
US20220217273A1 (en) Spherical camera with magnetic base
CN210832662U (en) A kind of refrigerator
CN109121031A (en) A kind of audio frequency apparatus orientation display methods, device and audio frequency apparatus
CN206023941U (en) A kind of live all-in-one of the full-automatic recorded broadcast based on three cameras
CN113824864A (en) Food material storage device and image processing method
US20240241262A1 (en) System and method of capturing and generating panoramic three-dimensional images
CN108224786B (en) Integrated projection water heater, projection control method and readable storage medium
CN110235048A (en) Equipment, the method for this equipment of operation for communication
US20240205529A1 (en) Camera with speaker box
CN204723740U (en) Intelligent solar cage-shaped football field
CN206097836U (en) Elevator projection arrangement based on infrared control
CN104076594B (en) A kind of rotary mirror type Microsecond grade process space time information improves recorder
CN117847919A (en) Refrigerator with a refrigerator body
CN117847918A (en) Refrigerator with a refrigerator body

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination