[go: up one dir, main page]

CN108803895A - Coordinate determination method, device and equipment - Google Patents

Coordinate determination method, device and equipment Download PDF

Info

Publication number
CN108803895A
CN108803895A CN201810422075.7A CN201810422075A CN108803895A CN 108803895 A CN108803895 A CN 108803895A CN 201810422075 A CN201810422075 A CN 201810422075A CN 108803895 A CN108803895 A CN 108803895A
Authority
CN
China
Prior art keywords
depth
preset calibration
coordinate
field
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810422075.7A
Other languages
Chinese (zh)
Inventor
李加云
陈维亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN201810422075.7A priority Critical patent/CN108803895A/en
Publication of CN108803895A publication Critical patent/CN108803895A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

A kind of coordinate determination method of offer of the embodiment of the present invention, device and equipment, this method include:Detection is happened at the corresponding target depth of field coordinate in depth of field detection zone of the operation in view field;According to target depth of field coordinate between the depth of field coordinate of N number of default calibration point in view field at a distance from, M default calibration points are selected from N number of default calibration point, the coordinate value that M default calibration points correspond to same reference axis is not exactly the same, N>M, M >=2;According to the projection coordinate of a default calibration points of M and depth of field coordinate and target depth of field coordinate, aforesaid operations corresponding target projection coordinate in view field is determined.Since N is more than M, hence for for the operation that the different location of view field triggers, selected M default calibration points may be different, the projection coordinate for being unlikely to all operating positions is required for realizing using identical calibration point, so helps to improve the accuracy of projection coordinate's definitive result.

Description

Coordinate determination method, device and equipment
Technical Field
The invention relates to the technical field of internet, in particular to a coordinate determination method, a coordinate determination device and coordinate determination equipment.
Background
The combination of micro-projection and intelligent products has prompted various micro-projection interactive electronic products, such as interactive intelligent projectors, projection speakers and the like. For example, an interface of an application program displayed in a computer screen can be projected by the intelligent projector onto a projection carrier such as a desktop, a wall, an electronic whiteboard, etc. for display, so that a user can interact with the application program based on a touch operation on a projection picture in a projection area.
The premise for completing the interaction is to identify an operation position where a user triggers an interaction operation in the projection area, that is, a projection coordinate corresponding to the operation in the projection area, where the projection area may be regarded as a projection coordinate system having a certain upper limit on horizontal and vertical coordinates.
Currently, a method for determining projection coordinates corresponding to a user operation position is as follows: and detecting a depth-of-field coordinate corresponding to the operation position of the user by using the infrared depth-of-field module, wherein when the depth-of-field detection area of the infrared depth-of-field module is overlapped with the projection area, the depth-of-field coordinate can be used as the projection coordinate corresponding to the operation position. However, in practical applications, for example, the infrared depth of field module is inadvertently touched to move, and at this time, the condition that the depth of field detection area coincides with the projection area is difficult to satisfy, so that the error of the determination result of the projection coordinate corresponding to the operation of the user in the projection area is large.
Disclosure of Invention
In view of this, embodiments of the present invention provide a coordinate determination method, apparatus and device, so as to improve accuracy of a determination result of a projection coordinate corresponding to a user operation.
In a first aspect, an embodiment of the present invention provides a coordinate determination method, including:
detecting a depth of field coordinate of a target corresponding to an operation occurring in a projection area in a depth of field detection area, wherein the depth of field detection area covers the projection area;
selecting M preset calibration points from the N preset calibration points according to the distance between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is greater than or equal to 2;
and determining the projection coordinates of the target corresponding to the operation in the projection area according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the depth of field coordinates of the target.
In a second aspect, an embodiment of the present invention provides a coordinate determination apparatus, including:
the depth-of-field coordinate detection module is used for detecting a depth-of-field coordinate of a target corresponding to an operation occurring in a projection area in the depth-of-field detection area, wherein the depth-of-field detection area covers the projection area;
the calibration point selection module is used for selecting M preset calibration points from the N preset calibration points according to the distance between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is greater than or equal to 2;
and the projection coordinate determination module is used for determining the corresponding target projection coordinate of the operation in the projection area according to the projection coordinate and the depth of field coordinate of the M preset calibration points and the target depth of field coordinate.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, where the memory is used to store one or more computer instructions, and when the one or more computer instructions are executed by the processor, the coordinate determination method in the first aspect is implemented. The electronic device may also include a communication interface for communicating with other devices or a communication network.
An embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to enable a computer to implement the coordinate determination method in the first aspect when executed.
In the coordinate determination method provided by the embodiment of the present invention, N preset calibration points are set in the projection area in advance, and the depth of field coordinate and the projection coordinate of each preset calibration point are determined in advance, where the N preset calibration points are used to determine the operation position of the operation triggered by the user in the projection area in the subsequent practical application, that is, to determine the projection coordinate corresponding to the operation triggered by the user. Based on the method, when a user triggers certain operation in a projection area, firstly, a depth-of-field coordinate corresponding to the operation position can be measured in a depth-of-field detection area, namely the depth-of-field coordinate is called as a target depth-of-field coordinate; further, M preset calibration points are selected from the N preset calibration points according to the distance between the target depth of field coordinates and the depth of field coordinates of the N preset calibration points, wherein N is larger than M and is larger than or equal to 2; therefore, the projection coordinates of the target corresponding to the operation in the projection area can be determined according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the obtained depth of field coordinates of the target.
Since the number N of preset calibration points preset in the projection area is greater than the number M of preset calibration points required for determining the projection position corresponding to a certain operation, for operations triggered at different positions of the projection area, the M preset calibration points selected may be different, that is, the preset calibration points for determining the projection coordinates corresponding to different operation positions may be different, which is helpful for improving the accuracy of the determination result of the projection coordinates, because compared with the case where the projection coordinates corresponding to all the operation positions need to be determined using the same preset calibration point, the influence of the coordinate error of the preset calibration point on the determination of the projection coordinates corresponding to all the operation positions is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of a projection coordinate system and a depth of field coordinate system;
fig. 2 is a flowchart of a first embodiment of a coordinate determination method according to the present invention;
FIG. 3 is a schematic diagram of a preset calibration point set in the projection area;
fig. 4 is a flowchart of a second embodiment of a coordinate determination method according to the present invention;
fig. 5 is a flowchart of a third embodiment of a coordinate determination method according to the present invention;
fig. 6 is a schematic structural diagram of a coordinate determination apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device corresponding to the coordinate determination apparatus provided in the embodiment shown in fig. 6.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
Before describing the coordinate determination method provided by the embodiment of the present invention, some concepts and basic principles of coordinate determination related to the following embodiments will be described.
The projection area refers to a projection coverage of an intelligent projection device such as an intelligent projector, a projection speaker, etc. on a projection carrier such as a wall, a desktop, etc., that is, a projection image projected onto the projection carrier by the intelligent projection device is displayed in the projection area. The projection area may be regarded as one projection coordinate system, but the horizontal and vertical coordinates of the projection coordinate system have a certain value range constraint (which depends on the length and width of the projection area), or the projection area may be regarded as one area in the projection coordinate system. Alternatively, as shown in fig. 1, the origin of coordinates of the projection coordinate system may be set at any one of the four vertices corresponding to the projection area, and the directions of the coordinate axes are parallel to or coincide with the boundary lines in the length and width directions of the projection area.
The depth-of-field detection area refers to an area range that the depth-of-field module, such as the infrared depth-of-field module, can detect on the projection carrier, that is, a range that the infrared signal can cover on the projection carrier. Generally, in order to be able to detect operations triggered by a user at various locations within the projection area, the depth of field detection area covers the projection area, i.e. the projection area is located within or coincides with the depth of field detection area. As shown in fig. 1, a case where the projection area is located within the depth detection area is illustrated. Similar to the projection coordinate system, the depth of field detection area corresponds to the depth of field coordinate system. The depth-of-field detection area may be regarded as a depth-of-field coordinate system, but the horizontal and vertical coordinates of the depth-of-field coordinate system have a certain value range constraint (which depends on the length and width of the depth-of-field detection area), or the depth-of-field detection area may be regarded as an area in the depth-of-field coordinate system. Alternatively, as shown in fig. 1, the origin of coordinates of the depth of field coordinate system may be set at any one of the four vertices corresponding to the depth of field detection area, and the directions of the coordinate axes are parallel to or coincide with the length-width direction boundary lines of the depth of field detection area.
For the convenience of subsequent calculation, as shown in fig. 1, the coordinate origin and the coordinate axis direction of the depth coordinate system and the projection coordinate system may be set to satisfy the following conditions: for example, if the position in the depth coordinate system corresponds to coordinates (X1, -Y1), the position in the projection coordinate system corresponds to coordinates (X2, -Y2).
In addition, the basic principle of determining the projection coordinates corresponding to a certain operation triggered in the projection area in the embodiment of the present invention is as follows: for the two points, the ratio of the difference between the abscissa values of the depth-of-field coordinates to the difference between the abscissa values of the projection coordinates is a fixed constant, and similarly, the ratio of the difference between the ordinate values of the depth-of-field coordinates to the difference between the ordinate values of the projection coordinates is also the fixed constant. The depth-of-field coordinate is a coordinate corresponding to the depth-of-field coordinate system, and the projection coordinate is a coordinate corresponding to the projection coordinate system. Based on this, for the projection coordinate to be obtained, the projection coordinate to be obtained can be calculated by knowing the corresponding depth of field coordinate and the projection coordinate of the two known points.
Fig. 2 is a flowchart of a first embodiment of a coordinate determination method according to an embodiment of the present invention, where the coordinate determination method in this embodiment may be executed by a coordinate determination apparatus, and the coordinate determination apparatus may be disposed in the depth module, or may also be disposed in the projection device, or may also be disposed in a data source device communicatively connected to the projection device, where the data source device is a device that provides data to the projection device and causes the projection device to project the data onto a projection carrier. As shown in fig. 2, the method comprises the steps of:
201. the depth of field coordinates of the object corresponding to the operation occurring in the projection area in the depth of field detection area are detected.
The detection of the target depth of field coordinate can be based on the detection of an infrared depth of field module, and the basic principle of the detection is as follows: the infrared depth of field module contains infrared transmitter and infrared receiver, and infrared transmitter constantly launches infrared signal, and infrared receiver gets the target depth of field coordinate through calculating the time difference that the infrared signal that sends returned infrared receiver, because the user is when touching the operation with the finger in the projection area, the infrared signal of directive operation position department.
202. And selecting M preset calibration points from the N preset calibration points according to the distance between the depth of field coordinates of the target and the depth of field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is not less than 2.
In the embodiment of the invention, in order to ensure the accuracy of the determination result of the projection coordinate corresponding to the operation triggered by the user in the projection area, a plurality of calibration points, namely N preset calibration points, are preset in the projection area, and the depth of field coordinate and the projection coordinate of each preset calibration point are also preset. The determination process of the depth coordinates and the projection coordinates of the preset calibration points is described in detail in the following embodiments, and the description of the embodiment is not expanded.
Based on the basic principle of determining the projection coordinates described above, it can be understood that the coordinate values of the N preset calibration points on the same coordinate axis of the projection coordinate system are not identical, for example, the coordinate values on the X axis are not identical, the coordinate values on the Y axis are not identical, and similarly, the coordinate values of the N preset calibration points on the same coordinate axis of the depth-of-field coordinate system are not identical. This is because if the coordinate values corresponding to the same coordinate axis are identical, the coordinate axis corresponding to the coordinate axis of the projection coordinate to be obtained cannot be calculated based on the coordinate values of the preset calibration points on the coordinate axis.
In an alternative embodiment, N preset calibration points may be randomly set within the projection area, and since at least two preset calibration points are required to determine a projection coordinate, N is at least 2. It is understood that when N is 2, M is 2.
However, when the value of N is 2, the two preset calibration points need to be used to determine the projection coordinates corresponding to any operation position in the projection area, and if there is an error in the detection result of the depth coordinates of the two preset calibration points, the error will be introduced into the calculation of the projection coordinates corresponding to all the operation positions, so in an optional embodiment, N is at least greater than or equal to 3, and thus, the determination of the projection coordinates corresponding to different operation positions only uses part of the preset calibration points, and even if there is an error in the depth coordinates of part of the preset calibration points in the N preset calibration points, the error will not affect the determination result of the projection coordinates corresponding to all the operation positions in the projection area, and it can be understood that M is 2 at this time.
Based on this, when N > M, it is necessary to calculate distances between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points, respectively, so as to select M preset calibration points from the N preset calibration points according to the distances. In an alternative embodiment, M preset calibration points with the depth of field coordinate closer to the target depth of field coordinate may be selected from the N preset calibration points. In an alternative embodiment, M preset calibration points with the depth of field coordinate farther from the target depth of field coordinate may be selected from the N preset calibration points. Whether M preset calibration points closer to or farther from the target depth of field coordinate are selected, it should be emphasized that in the embodiment of the present invention, the distance is used as a basis for selecting the preset calibration points, and mainly, a difference is provided between the preset calibration points used for determining the projection coordinates corresponding to different operation positions. Of course, in practical applications, M preset calibration points closer to the target depth of field coordinate are selected, for reasons explained in detail in the following embodiments.
The reason why the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical is the same as the reason why the coordinate values of the N preset calibration points corresponding to the same coordinate axis are not identical, and details are not repeated.
In practical applications, M generally takes the value of 2 or 3. When M is 3, the coordinate values of the three preset calibration points in the projection coordinate system may be characterized as: assuming that the three preset calibration points are A, B and C, respectively, the coordinate values of the X coordinate axes of two preset calibration points, such as A and C, are the same, and the coordinate values of the Y coordinate axes of the other two preset calibration points, such as A and B, are the same. Thus, the Y coordinate value in the projection coordinate corresponding to the operation can be determined according to the depth of field coordinate and the projection coordinate of the preset calibration points a and C and the target depth of field coordinate, and the X coordinate value in the projection coordinate corresponding to the operation can be determined according to the depth of field coordinate and the projection coordinate of the preset calibration points a and B and the target depth of field coordinate.
In summary, in an optional embodiment, the N preset calibration points may be sorted in order of decreasing distance to increasing distance based on the distance between the target depth-of-field coordinate and the depth-of-field coordinates of the N preset calibration points, so that if the coordinate values of the first two preset calibration points corresponding to the two coordinate axes are different, the two preset calibration points may be selected; if the coordinate values of the first two preset calibration points corresponding to a certain coordinate axis are different but the coordinate values of the first two preset calibration points corresponding to another coordinate axis are the same, the preset calibration point arranged at the first three position can be selected as long as the coordinate value of the preset calibration point arranged at the third position corresponding to the other coordinate axis is different from the coordinate values of the first two preset calibration points corresponding to the other coordinate axis.
In addition, when the value of N is too large, when M preset calibration points for determining the projection coordinate corresponding to a certain current operation are selected from the N preset calibration points, distances between the depth-of-field coordinates of the target corresponding to the operation and the depth-of-field coordinates of the N preset calibration points may need to be calculated, that is, N times of calculation may be required, so as to select M preset calibration points from the N preset calibration points, where the depth-of-field coordinates are closer to the depth-of-field coordinates of the target. Therefore, the value of N needs to be compromised between the calculated amount and the accuracy of the projection coordinate, and the compromise scheme is provided in the subsequent embodiment of the invention, so that the calculated amount is effectively reduced while the accuracy of the determination result of the projection coordinate is ensured.
203. And determining the corresponding target projection coordinates of the operation in the projection area according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the target depth of field coordinates.
Assuming that M is 2, and assuming that the two selected preset calibration points are a and b, the projection coordinates corresponding to a in the projection coordinate system are (Xa1, Ya1), the depth of field coordinates corresponding to a in the depth of field coordinate system are (Xa2, Ya2), the projection coordinates corresponding to b in the projection coordinate system are (Xb1, Yb1), the depth of field coordinates corresponding to b in the depth of field coordinate system are (Xb2, Yb2), and the depth of field coordinates corresponding to the operation in the depth of field detection region are (Xc2, Yc2), the projection coordinates (Xc1, Yc1) corresponding to the operation in the projection region can be determined according to the following formula:
(Xa2-Xb2)/(Xa1-Xb1)=(Xa2-Xc2)/(Xa1-Xc1),
(Ya2-Yb2)/(Ya1-Yb1)=(Ya2-Yc2)/(Ya1-Yc1)。
the target projection coordinates (Xc1, Yc1) can be obtained by solving the above formula.
In summary, in the embodiment of the present invention, a plurality of preset calibration points are preset in the projection area, and the depth of field coordinates and the projection coordinates of each preset calibration point are preset, so that the projection coordinates corresponding to any operation triggered by the user are determined based on the preset calibration points. Since the number N of preset calibration points preset in the projection area is greater than the number M of preset calibration points required for determining the projection position corresponding to a certain operation, for operations triggered at different positions of the projection area, the M preset calibration points selected may be different, that is, the preset calibration points for determining the projection coordinates corresponding to different operation positions may be different, which is helpful for improving the accuracy of the determination result of the projection coordinates, because compared with the case where the projection coordinates corresponding to all the operation positions need to be determined using the same preset calibration point, the influence of the coordinate error of the preset calibration point on the determination of the projection coordinates corresponding to all the operation positions is reduced.
In the foregoing embodiment, N preset calibration points are preset in the projection area, and the projection coordinates and the depth coordinates of each preset calibration point are measured, so as to be used for determining the projection coordinates corresponding to the operation triggered in the projection area in the subsequent practical application. In an alternative embodiment, the N preset calibration points may be randomly distributed in the projection area, but in order to further improve the accuracy of the determination result of the projection coordinates corresponding to the operation triggered at any position in the projection area and reduce the calculation amount as much as possible, the embodiment of the present invention further provides a setting manner of the N preset calibration points as shown in fig. 3.
As shown in fig. 3, the N preset calibration points perform mesh division on the projection area, and the mesh division is performed on at least one mesh, generally a plurality of meshes. It is understood that when dividing into a grid, N is 4, and the 4 preset calibration points are the four vertices of the rectangular projection area. Illustrated in fig. 3 is a six grid dividing the projection area into two rows and three columns with 12 preset calibration points. Optionally, the mesh division of the projection area may be implemented based on the embodiment shown in fig. 4:
fig. 4 is a flowchart of a second embodiment of a coordinate determination method according to an embodiment of the present invention, and as shown in fig. 4, the method may include the following steps:
401. and determining N preset calibration points according to the size information of the projection area, wherein the N preset calibration points divide the projection area into at least one grid, and the N preset calibration points correspond to the top point of the at least one grid.
The method comprises the steps of determining N preset calibration points according to size information of a projection area, on one hand, determining a numerical value of N, and on the other hand, determining an arrangement mode of the N preset calibration points, namely setting positions of the N preset calibration points in the projection area.
The size information may include the length and width of the projection area, and may further include a display scale, i.e., an aspect ratio.
In an alternative embodiment, N preset calibration points may be determined based on the display scale, for example, N may be determined to be 12 assuming that the display scale is 4:3, thereby dividing the projection area into six grids of two rows and three columns, i.e., six grids formed by four longitudinal boundary lines and three transverse boundary lines crossing each other.
Of course, when the N preset calibration points are determined in combination with the display scale, it is also necessary to determine whether the N preset calibration points are suitable in combination with the area of the projection area and the size of the divided grid. Because the smaller the area of the projection region is, the smaller the divided grid is, the less favorable the balance between the amount of computation and the accuracy of the projection coordinate determination result is if the grid is too small, for example, less than a certain threshold value, and similarly, the larger the area of the projection region is, the larger the divided grid is, the more favorable the balance between the amount of computation and the accuracy of the projection coordinate determination result is if the grid is too large, for example, less than a certain threshold value.
In an optional embodiment, the size of each grid may also be preset, and the value of N and the arrangement manner of the grids are determined according to how many preset-sized grids can be accommodated by the size information of the projection area, so as to determine the setting positions of the N preset calibration points in the projection area.
402. And determining projection coordinates corresponding to the N preset calibration points by combining the size information of the projection area.
The size information here refers to the length and width of the projection area, and as shown in fig. 3, it is assumed that the 1 st preset calibration point is the origin of coordinates (0,0) of the projection coordinate system, and the projection coordinates of the 12 th preset calibration point are coordinate values (l, w) formed by the length and width values of the projection area, where l and w represent the length and width of the projection area, respectively.
403. And projecting and displaying the N preset calibration points so that the user can click the N preset calibration points.
404. And responding to the clicking operation of the user on the N preset calibration points, and detecting the depth of field coordinates corresponding to the N preset calibration points.
In order to obtain the depth of field coordinates of the N preset calibration points, the projection area provided with the N preset calibration points may be used as an image for projection display, which is to display the N preset calibration points in the projection area, so that the user can see the preset calibration points, and then prompt the user to click each preset calibration point in sequence, thereby detecting the depth of field coordinates corresponding to each preset calibration point.
In summary, theoretically, the more the number of the preset calibration points is, the more accurate the determination result of the projection coordinate corresponding to the operation triggered by the user is. However, when the user clicks the preset calibration point to measure the depth of field coordinates of each preset calibration point, a certain error may exist in the click position of the user, that is, the user does not click the preset calibration point exactly, so that a certain error may exist in the depth of field coordinates of some preset calibration points. On the basis that the errors of the depth-of-field coordinates of the preset calibration points have adverse effects on the determination of the projection coordinates, if the number of the preset calibration points is very small, such as 2, the two preset calibration points are required to be used for the determination of the projection coordinates corresponding to all operations triggered by the user, and the errors of the depth-of-field coordinates of the two preset calibration points are brought into the calculation of the projection coordinates corresponding to all the operations, so that the accuracy of the determination results of all the projection coordinates is affected. However, on the contrary, if the number of the preset calibration points is too large, although errors do not affect the accuracy of the determination result of all the projection coordinates even if errors exist in the depth coordinates of some of the preset calibration points, the too large number of the preset calibration points will not only increase the complexity of the user operation because the user needs to click each preset calibration point, but also increase the calculation amount and affect the calculation speed because M preset calibration points needed for determining the current projection coordinates need to be selected from all the preset calibration points. Therefore, in practical application, the number of preset calibration points needs to be reasonably set by combining the size information of the projection area, and compromise is made between the calculation amount and the accuracy of the projection coordinate determination result.
Thus, after the projection area is gridded by the N preset calibration points and the projection coordinates and the depth of field coordinates corresponding to the N preset calibration points are obtained, the projection coordinates corresponding to the actual operation behavior of the user can be determined based on the N preset calibration points, which is described in detail in the embodiment shown in fig. 5. In addition, the embodiment shown in fig. 5 also provides a processing scheme for reducing the calculation amount as much as possible while ensuring the accuracy of the determination result.
Fig. 5 is a flowchart of a third embodiment of a coordinate determination method according to an embodiment of the present invention, and as shown in fig. 5, the method may include the following steps:
501. and detecting the depth of field coordinates of the target corresponding to the operation in the projection area in the depth of field detection area, wherein the depth of field detection area covers the projection area.
502. And selecting three preset calibration points with the target depth of field coordinates close to the target depth of field coordinates from the N preset calibration points according to the distance between the target depth of field coordinates and the depth of field coordinates of the N preset calibration points, wherein the three preset calibration points correspond to three vertexes of the same grid.
In this embodiment, based on a result of mesh division performed on the projection area, three preset calibration points may be selected from the N preset calibration points to determine a target projection coordinate corresponding to an operation triggered by the current user, where distances between the three preset calibration points and the target depth-of-field coordinate are closest, that is, distances between the target depth-of-field coordinate and the depth-of-field coordinates of the three preset calibration points are smaller than distances between the target depth-of-field coordinates and depth-of-field coordinates of the remaining other preset calibration points, and actually, the three preset calibration points are three vertices of the same mesh.
In addition, based on the grid division of the projection area by using the N preset calibration points, if there is an error in the four preset calibration points corresponding to a certain grid, only the determination accuracy of the projection coordinates corresponding to the operation triggered by the user in the grid is affected, and the determination of the projection coordinates of other operation positions is not affected.
In an optional embodiment, the grid into which the target depth of field coordinate falls may be determined, and then, according to the distances between the target depth of field coordinate and the depth of field coordinates of the four preset calibration points of the grid, one preset calibration point closest to the target depth of field coordinate is selected, and then two preset calibration points adjacent to the preset calibration point in the grid are selected, so as to obtain the three preset calibration points.
In an optional embodiment, after obtaining the distance between the depth-of-field coordinate of the target and the depth-of-field coordinates of the N preset calibration points, the distances may be sorted in the order from small to large, and the first three preset calibration points may be selected, where the three preset calibration points correspond to three vertices of a certain mesh.
In an alternative embodiment, to reduce the amount of computation required to select the three preset calibration points, the three preset calibration points may also be selected as follows: and selecting three preset calibration points from the N preset calibration points according to the size relationship between the target depth-of-field coordinates and the average values of the N1 horizontal coordinates and the average values of the N2 vertical coordinates.
Firstly, the meaning of the N1 abscissa mean values and the N2 ordinate mean values is described, and then the selection process of three preset calibration points is described:
after the projection area is subjected to grid division, the horizontal boundary and the vertical boundary of the grid respectively pass through a plurality of preset calibration points, the horizontal boundary of the grid is parallel to the X axis of the projection coordinate system, and the vertical boundary of the grid is parallel to the Y axis of the projection coordinate system, so that for each horizontal boundary, the average value of the horizontal coordinate values in the depth of field coordinates of a plurality of preset calibration points experienced by each horizontal boundary can be obtained, and the horizontal coordinate average value corresponding to each horizontal boundary can be obtained; similarly, for each longitudinal boundary, an average value of ordinate values in the depth-of-field coordinates of the plurality of preset calibration points experienced by each longitudinal boundary may be obtained, so as to obtain an average value of ordinate corresponding to each longitudinal boundary.
That is, assuming that the result of the meshing of the projection area indicates that the meshes are formed by intersecting N1 vertical dividing lines and N2 horizontal dividing lines, N1 horizontal-axis mean values and N2 vertical-axis mean values are generated. Each vertical grid boundary line has N2 preset calibration points, and the average of the abscissa values in the depth of field coordinates of the N2 preset calibration points is one of the N1 abscissa averages and corresponds to the vertical grid boundary line. Similarly, each horizontal grid boundary has N1 default calibration points, and the average of the ordinate values in the depth of field coordinates of the N1 default calibration points is one of the N2 ordinate averages and corresponds to the horizontal grid boundary.
After obtaining the above-mentioned N1 abscissa averages and N2 ordinate averages, the following labeling process may be performed for each of the N preset calibration points: for any one of the predetermined calibration points, since the predetermined calibration point is an intersection of a horizontal grid dividing line and a vertical grid dividing line, the predetermined calibration point can be marked by an abscissa mean value corresponding to the vertical grid dividing line and an ordinate mean value corresponding to the horizontal grid dividing line.
The above process is exemplified by fig. 3, and as can be seen from the result of the grid division in fig. 3, the grids correspond to four vertical grid boundaries and three horizontal grid boundaries, and it is assumed that the horizontal coordinate mean values corresponding to the four vertical grid boundaries are: xave1,Xave2,Xave3,Xave4(ii) a The mean values of the vertical coordinates corresponding to the three horizontal grid boundary lines are respectively as follows: y isave1,Yave2,Yave3. Wherein, with Xave1For example, the average value is obtained by averaging the abscissa values of the depth-of-field coordinates of the three preset calibration points labeled as 1, 5 and 9, and the other abscissa averages are the same; with Yave1For example, the average value is obtained by averaging ordinate values of the depth of field coordinates of the four preset calibration points denoted by reference numerals 1, 2, 3, and 4, and the other ordinate averages are the same. Thus, taking the preset calibration point labeled 1 as an example, one can cite (X)ave1,Yave1) The preset calibration point is marked.
As mentioned above, when the depth of field coordinates of the N preset calibration points are detected, there may be an error in the click position for the user to click on the preset calibration point, which may cause an error in the depth of field coordinates of some of the N preset calibration points. For example, as shown in fig. 3, theoretically, the abscissa values of the three preset calibration points, labeled with numbers 1, 5, and 9, should be the same, but actually, due to the error, the abscissa values of the three preset calibration points may not be completely the same, and at this time, the abscissa values of the three preset calibration points are marked with the abscissa mean value by performing the averaging operation on the abscissa values of the three preset calibration points, so as to reduce the error, because the mean value is closer to the theoretical value (the abscissa values of the three preset calibration points when there is no error).
In addition, reducing the error also ensures that the three preset calibration points closest to the target depth of field coordinate can be accurately selected from the N preset calibration points, i.e., the three preset calibration points closest to the target depth of field coordinate can be selected based on the marked horizontal and vertical coordinate mean values of the preset calibration points when selected from the N preset calibration points.
In addition, in the present embodiment, the above-mentioned averaging process is performed on the depth coordinates of each preset calibration point, and the marking process is performed on each preset calibration point by using the obtained mean value of the abscissa and mean value of the ordinate, so as to reduce the calculation amount, where the reduction of the calculation amount mainly means reducing the calculation amount required for the selection process in the process of selecting three preset calibration points from the N preset calibration points, and the specific description is as follows:
in practice, the three preset calibration points closest to the target depth of field coordinate distance include: the calibration point comprises a first preset calibration point closest to the distance between the coordinate of the target depth of field, a second preset calibration point second closest in distance between the abscissa value and the abscissa value of the coordinate of the target depth of field and closest in distance between the ordinate value and the ordinate value of the coordinate of the target depth of field, and a third preset calibration point third closest in distance between the abscissa value and the abscissa value of the coordinate of the target depth of field and second closest in distance between the ordinate value and the ordinate value of the coordinate of the target depth of field. It is understood that the abscissa and ordinate values are coordinate values in the depth coordinate system.
Taking fig. 3 as an example, the black dots in the graph are the operation positions of the user in the projection area, and it is assumed that the coordinates of the depth of field of the target are: (x, y), assuming that the target projection coordinates to be found are (Ax, Ay). As can be seen from the figure: a first preset calibration point which is closest to the distance between the target depth of field coordinates (i.e. the distance between the abscissa value and the abscissa value of the target depth of field coordinates is closest and the distance between the ordinate value and the ordinate value of the target depth of field coordinates is closest) is a preset calibration point with the reference number 11; the second preset calibration point, at which the distance between the abscissa value and the abscissa value of the target depth of field coordinate is the second closest and the distance between the ordinate value and the ordinate value of the target depth of field coordinate is the preset calibration point denoted by 10, and the third preset calibration point, at which the distance between the abscissa value and the abscissa value of the target depth of field coordinate is the second closest and the distance between the ordinate value and the ordinate value of the target depth of field coordinate is the third preset calibration point denoted by 7.
Taking fig. 3 as an example, the selection principle of the three preset calibration points is as follows: when calculating Ax, two preset calibration points meeting the following conditions need to be selected in the direction of the abscissa axis:
a first preset calibration point with the shortest distance between the abscissa value and the abscissa value of the target depth-of-field coordinate and the shortest distance between the ordinate value and the ordinate value of the target depth-of-field coordinate; and the number of the first and second groups,
and the distance between the abscissa value and the abscissa value of the target depth of field coordinate is the second closest, and the distance between the ordinate value and the ordinate value of the target depth of field coordinate is the closest.
When Ay is calculated, two preset calibration points meeting the following conditions need to be selected in the direction of the ordinate axis:
a first preset calibration point with the shortest distance between the abscissa value and the abscissa value of the target depth-of-field coordinate and the shortest distance between the ordinate value and the ordinate value of the target depth-of-field coordinate; and the number of the first and second groups,
and the distance between the abscissa value and the abscissa value of the target depth of field coordinate is the closest, and the distance between the ordinate value and the ordinate value of the target depth of field coordinate is the second closest.
Based on the above principle, taking fig. 3 as an example, in the process of selecting the three preset calibration points: respectively taking the abscissa value X of the target depth coordinate and each abscissa mean value Xave1,Xave2,Xave3,Xave4And (3) carrying out subtraction operation to obtain two abscissa mean values with the minimum difference value and the second smallest difference value: xave3,Xave2. Similarly, the longitudinal coordinate value Y of the target depth coordinate and the mean value Y of each longitudinal coordinate are usedave1,Yave2,Yave3And (3) carrying out subtraction operation to obtain two ordinate mean values with the minimum difference value and the second smallest difference value: y isave3,Yave2. Thus, the label is the minimum abscissa mean Xave3And minimum ordinate mean Yave3The preset calibration point of reference numeral 11 is the first preset calibration point; marked as the second smallest abscissa mean Xave2And minimum ordinate mean Yave3The preset calibration point of reference numeral 10 is the second preset calibration point; marked as minimum abscissa mean Xave3And second smallest ordinate mean value Yave2The preset calibration point of reference numeral 7 is the third preset calibration point described above.
Therefore, in the selection process, assuming that there are N1+ N2 average values of the abscissa and ordinate, the required three preset calibration points can be obtained only by performing N1+ N2 subtractions on the abscissa and ordinate of the target depth-of-field coordinate. The amount of calculation is greatly reduced compared to the amount of calculation N1 × N2 required to calculate the distance between the target depth of field coordinates and the depth of field coordinates of N (where N — N1 × N2) preset calibration points, respectively.
In the present embodiment, it is assumed that: (xm, yi) is the depth of field coordinates of the first preset calibration point in advance, (Axm, Ayi) is the projection coordinates of the first preset calibration point; (xn, yi) is the depth of field coordinate of the second preset calibration point, and (Axn, Ayi) is the projection coordinate of the second preset calibration point; (xm, yj) is the depth of field coordinates of the third preset calibration point, (Axm, Ayj) is the projection coordinates of the third preset calibration point; (x, y) are the target depth of field coordinates, which are known, the target projection coordinates (Ax, Ay) can be calculated according to the following step 503:
503. the abscissa value Ax of the target projection coordinate corresponding to the operation in the projection area is determined according to the formula (xm-xn)/(Axm-Axn) ═ xm-x)/(Axm-Ax), and the ordinate value Ay of the target projection coordinate corresponding to the operation in the projection area is determined according to the formula (yi-yj)/(Ayi-Ayj) ═ yi-y)/(Ayi-Ay).
From the above formula, it can be seen that:
Ax=Axm-(Axm-Axn)*(xm-x)/(xm-xn);
Ay=Ayi-(Ayi-Ayj)*(yi-y)/(yi-yj)。
it should be noted that, taking the calculation of Ax as an example, the calculation is performed by selecting (xm-x)/(Axm-Ax), that is, selecting the preset calibration point with the smallest difference between the abscissa value of the abscissa and the abscissa value of the target depth-of-field coordinate, rather than selecting the preset calibration point with the second smallest difference, that is, the right side of the equation equal sign in step 503 is not selected to be (xn-x)/(Axn-Ax), because: as can be seen from the formula of Ax Axm- (Axm-Axn) × (xm-x)/(xm-xn), the portion of the final calculation result that introduces errors is (Axm-Axn)/(xm-xn), i.e., the ratio between the difference between the projected abscissa values and the difference between the depth-of-field abscissa values, and as a multiplication factor to be multiplied by the error portion, the smaller the value, the smaller the amplification effect on errors, and (xm-x) is significantly smaller than (xn-x), and therefore the value of the introduced errors is also small. An extreme example is that x is xm, i.e. the operating position of the user at the moment is exactly located at a certain preset calibration point, and Ax is Axm, which is exactly the projected coordinate value of the preset calibration point.
504. And determining the validity of the target projection coordinate according to whether the target projection coordinate (Ax, Ay) is positioned in the coverage range of the projection area.
In practical applications, only the operation triggered by the user in the projection area is valid, and therefore, after the target projection coordinates (Ax, Ay) are determined, whether the target projection coordinates (Ax, Ay) are within the coverage of the projection area can be judged to determine the validity of the target projection coordinates. If the target projection coordinate (Ax, Ay) is valid, that is, located in the projection area, then a normal subsequent process is performed, otherwise, if the target projection coordinate (Ax, Ay) is invalid, optionally, the user may be prompted that the operation is invalid or no response is made, and the prompt may be provided by text, voice, or the like.
In summary, according to the projection coordinate determination scheme provided by the embodiment of the invention, the projection coordinate determination result corresponding to the operation position of the user is ensured to have good accuracy, the calculation amount can be reduced, and the coordinate determination efficiency is improved.
The coordinate determination apparatus of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that these coordinate determination devices can each be constructed using commercially available hardware components configured through the steps taught in the present scheme.
Fig. 6 is a schematic structural diagram of a coordinate determination apparatus according to an embodiment of the present invention, as shown in fig. 6, the apparatus includes: a depth of field coordinate detection module 11, a calibration point selection module 12, and a projection coordinate determination module 13.
The depth-of-field coordinate detection module 11 is configured to detect a depth-of-field coordinate of a target, which corresponds to an operation occurring in a projection area and is in the depth-of-field detection area, where the depth-of-field detection area covers the projection area.
And the calibration point selection module 12 is configured to select M preset calibration points from the N preset calibration points according to distances between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, where coordinate values of the M preset calibration points corresponding to the same coordinate axis are not completely the same, N is greater than M, and M is greater than or equal to 2.
And the projection coordinate determination module 13 is configured to determine, according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the depth of field coordinates of the target, target projection coordinates corresponding to the operation in the projection area.
Optionally, the N preset calibration points divide the projection area into at least one grid.
Based on the meshing results, the calibration point selection module 12 may optionally be configured to:
and selecting three preset calibration points adjacent to the target depth of field coordinate from the N preset calibration points according to the distance between the target depth of field coordinate and the depth of field coordinate of the N preset calibration points, wherein the three preset calibration points correspond to three vertexes of the same grid.
Optionally, the three preset calibration points comprise: the calibration point comprises a first preset calibration point closest to the distance between the target depth of field coordinates, a second preset calibration point second closest in distance between an abscissa value of the target depth of field coordinates and closest in distance between an ordinate value of the target depth of field coordinates and an ordinate value of the target depth of field coordinates, and a third preset calibration point third closest in distance between the abscissa value of the target depth of field coordinates and closest in distance between the ordinate value of the target depth of field coordinates and the ordinate value of the target depth of field coordinates.
Optionally, the projection coordinate determination module 13 may be configured to: determining an abscissa value Ax of a corresponding target projection coordinate of the operation in the projection region according to the following formula: (xm-xn)/(Axm-Axn) ═ xm-x)/(Axm-Ax); determining a longitudinal coordinate value Ay of a corresponding target projection coordinate in the projection area according to the following formula: (yi-yj)/(Ayi-Ayj) ═ yi-y)/(Ayi-Ay).
Wherein, (xm, yi) is the depth of field coordinates of the first preset calibration point obtained in advance, (Axm, Ayi) is the projection coordinates of the first preset calibration point obtained in advance, (xn, yi) is the depth of field coordinates of the second preset calibration point obtained in advance, and (Axn, Ayi) is the projection coordinates of the second preset calibration point obtained in advance; (xm, yj) is the depth of field coordinates of the third preset calibration point obtained in advance, (Axm, Ayj) is the projection coordinates of the third preset calibration point obtained in advance, (x, y) is the target depth of field coordinates, and (Ax, Ay) is the target projection coordinates.
Optionally, the projection coordinate determination module 13 may be further configured to: and determining the effectiveness of the target projection coordinate according to whether the target projection coordinate is positioned in the coverage range of the projection area.
Optionally, the calibration point selection module 12 may be further configured to: selecting M preset calibration points from the N preset calibration points according to the size relationship between the target depth-of-field coordinate and the average values of the N1 horizontal coordinates and the average values of the N2 vertical coordinates; the average value of the abscissa values in the depth of field coordinates of N2 preset calibration points on each longitudinal grid boundary is used as one of the N1 abscissa average values; taking the average value of longitudinal coordinate values in the depth of field coordinates of N1 preset calibration points on each transverse grid boundary line as one of the N2 longitudinal coordinate average values; each pre-set calibration point is uniquely marked by an abscissa mean and an ordinate mean.
Optionally, the apparatus may further include:
a calibration point setting module, configured to determine the N preset calibration points according to size information of the projection area, where the N preset calibration points correspond to vertices of the at least one mesh; determining projection coordinates corresponding to the N preset calibration points by combining the size information of the projection area; projecting and displaying the N preset calibration points so that a user can click the N preset calibration points; and responding to the clicking operation of the user on the N preset calibration points, and detecting the depth of field coordinates corresponding to the N preset calibration points.
The apparatus shown in fig. 6 can perform the method of the embodiment shown in fig. 1-5, and the detailed description of this embodiment can refer to the related description of the embodiment shown in fig. 1-5. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 1 to 5, and are not described herein again.
Having described the internal functions and structure of the coordinate determination apparatus, in one possible design, the structure of the coordinate determination apparatus may be implemented as an electronic device, such as a smart projection device, a depth module, etc., as shown in fig. 7, which may include: a processor 21 and a memory 22. Wherein the memory 22 is used for storing a program for supporting an electronic device to execute the coordinate determination method provided in the embodiments shown in fig. 1-5, and the processor 21 is configured to execute the program stored in the memory 22.
The program comprises one or more computer instructions which, when executed by the processor 21, are capable of performing the steps of:
detecting a depth of field coordinate of a target corresponding to an operation occurring in a projection area in a depth of field detection area, wherein the depth of field detection area covers the projection area;
selecting M preset calibration points from the N preset calibration points according to the distance between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is greater than or equal to 2;
and determining the projection coordinates of the target corresponding to the operation in the projection area according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the depth of field coordinates of the target.
Optionally, the processor 21 is further configured to perform all or part of the steps in the embodiments shown in fig. 1 to 5.
The electronic device may further include a communication interface 23 for communicating with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the coordinate determination method in the method embodiments shown in fig. 1 to 5.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described aspects and portions of the present technology which contribute substantially or in part to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including without limitation disk storage, CD-ROM, optical storage, and the like.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable coordinate determination device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable coordinate determination device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable coordinate determination apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable coordinate determination device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A coordinate determination method, comprising:
detecting a depth of field coordinate of a target corresponding to an operation occurring in a projection area in a depth of field detection area, wherein the depth of field detection area covers the projection area;
selecting M preset calibration points from the N preset calibration points according to the distance between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is greater than or equal to 2;
and determining the projection coordinates of the target corresponding to the operation in the projection area according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the depth of field coordinates of the target.
2. The method of claim 1, wherein the N preset calibration points divide the projection area into at least one grid.
3. The method according to claim 2, wherein the selecting M preset calibration points from the N preset calibration points according to the distance between the depth of field coordinates of the target and the depth of field coordinates of the N preset calibration points in the projection area comprises:
and selecting three preset calibration points adjacent to the target depth of field coordinate from the N preset calibration points according to the distance between the target depth of field coordinate and the depth of field coordinate of the N preset calibration points, wherein the three preset calibration points correspond to three vertexes of the same grid.
4. The method of claim 3, wherein the three preset calibration points comprise: the calibration point comprises a first preset calibration point closest to the distance between the target depth of field coordinates, a second preset calibration point second closest in distance between an abscissa value of the target depth of field coordinates and closest in distance between an ordinate value of the target depth of field coordinates and an ordinate value of the target depth of field coordinates, and a third preset calibration point third closest in distance between the abscissa value of the target depth of field coordinates and closest in distance between the ordinate value of the target depth of field coordinates and the ordinate value of the target depth of field coordinates.
5. The method according to claim 4, wherein the determining the corresponding target projection coordinates of the operation in the projection area according to the projection coordinates and the depth of field coordinates of the M preset calibration points and the target depth of field coordinates comprises:
determining an abscissa value Ax of a corresponding target projection coordinate of the operation in the projection region according to the following formula: (xm-xn)/(Axm-Axn) ═ xm-x)/(Axm-Ax);
determining a longitudinal coordinate value Ay of a corresponding target projection coordinate in the projection area according to the following formula: (yi-yj)/(Ayi-Ayj) ═ yi-y)/(Ayi-Ay);
wherein, (xm, yi) is the depth of field coordinates of the first preset calibration point obtained in advance, (Axm, Ayi) is the projection coordinates of the first preset calibration point obtained in advance, (xn, yi) is the depth of field coordinates of the second preset calibration point obtained in advance, and (Axn, Ayi) is the projection coordinates of the second preset calibration point obtained in advance; (xm, yj) is the depth of field coordinates of the third preset calibration point obtained in advance, (Axm, Ayj) is the projection coordinates of the third preset calibration point obtained in advance, (x, y) is the target depth of field coordinates, and (Ax, Ay) is the target projection coordinates.
6. The method of any of claims 1 to 5, wherein the determining the operation is subsequent to the corresponding target projection coordinates in the projection region, further comprising:
and determining the effectiveness of the target projection coordinate according to whether the target projection coordinate is positioned in the coverage range of the projection area.
7. The method according to any one of claims 2 to 5, wherein the selecting M preset calibration points from the N preset calibration points according to the distance between the object depth of field coordinates and the depth of field coordinates of the N preset calibration points in the projection area comprises:
selecting M preset calibration points from the N preset calibration points according to the size relationship between the target depth-of-field coordinate and the average values of the N1 horizontal coordinates and the average values of the N2 vertical coordinates;
the average value of the abscissa values in the depth of field coordinates of N2 preset calibration points on each longitudinal grid boundary is used as one of the N1 abscissa average values; taking the average value of longitudinal coordinate values in the depth of field coordinates of N1 preset calibration points on each transverse grid boundary line as one of the N2 longitudinal coordinate average values; each pre-set calibration point is uniquely marked by an abscissa mean and an ordinate mean.
8. The method according to any one of claims 2 to 5, further comprising:
determining the N preset calibration points according to the size information of the projection area, wherein the N preset calibration points correspond to the top point of the at least one grid;
determining projection coordinates corresponding to the N preset calibration points by combining the size information of the projection area;
projecting and displaying the N preset calibration points so that a user can click the N preset calibration points;
and responding to the clicking operation of the user on the N preset calibration points, and detecting the depth of field coordinates corresponding to the N preset calibration points.
9. A coordinate determination apparatus, comprising:
the depth-of-field coordinate detection module is used for detecting a depth-of-field coordinate of a target corresponding to an operation occurring in a projection area in the depth-of-field detection area, wherein the depth-of-field detection area covers the projection area;
the calibration point selection module is used for selecting M preset calibration points from the N preset calibration points according to the distance between the depth-of-field coordinates of the target and the depth-of-field coordinates of the N preset calibration points in the projection area, wherein the coordinate values of the M preset calibration points corresponding to the same coordinate axis are not identical, N is greater than M, and M is greater than or equal to 2;
and the projection coordinate determination module is used for determining the corresponding target projection coordinate of the operation in the projection area according to the projection coordinate and the depth of field coordinate of the M preset calibration points and the target depth of field coordinate.
10. An electronic device, comprising: a memory, a processor; wherein,
the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the coordinate determination method of any of claims 1-8.
CN201810422075.7A 2018-05-04 2018-05-04 Coordinate determination method, device and equipment Pending CN108803895A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810422075.7A CN108803895A (en) 2018-05-04 2018-05-04 Coordinate determination method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810422075.7A CN108803895A (en) 2018-05-04 2018-05-04 Coordinate determination method, device and equipment

Publications (1)

Publication Number Publication Date
CN108803895A true CN108803895A (en) 2018-11-13

Family

ID=64093305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810422075.7A Pending CN108803895A (en) 2018-05-04 2018-05-04 Coordinate determination method, device and equipment

Country Status (1)

Country Link
CN (1) CN108803895A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040201575A1 (en) * 2003-04-08 2004-10-14 Morrison Gerald D. Auto-aligning touch system and method
CN104820523A (en) * 2015-05-19 2015-08-05 京东方科技集团股份有限公司 Method and device for realizing touch control
CN106289320A (en) * 2016-08-01 2017-01-04 唐子渊 A kind of error calibrating method and device
CN107506162A (en) * 2017-08-29 2017-12-22 歌尔科技有限公司 Coordinate mapping method, computer-readable recording medium and projecting apparatus
CN107577351A (en) * 2017-09-26 2018-01-12 歌尔科技有限公司 Coordinate mapping method, device, projecting apparatus and the optical projection system of view field

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040201575A1 (en) * 2003-04-08 2004-10-14 Morrison Gerald D. Auto-aligning touch system and method
CN104820523A (en) * 2015-05-19 2015-08-05 京东方科技集团股份有限公司 Method and device for realizing touch control
CN106289320A (en) * 2016-08-01 2017-01-04 唐子渊 A kind of error calibrating method and device
CN107506162A (en) * 2017-08-29 2017-12-22 歌尔科技有限公司 Coordinate mapping method, computer-readable recording medium and projecting apparatus
CN107577351A (en) * 2017-09-26 2018-01-12 歌尔科技有限公司 Coordinate mapping method, device, projecting apparatus and the optical projection system of view field

Similar Documents

Publication Publication Date Title
US11288525B2 (en) Object detection for distorted images
US12266045B2 (en) Lightmap updating method and apparatus, electronic device, and storage medium
TWI601020B (en) Chart analysis system and chart analysis method
CN113986426B (en) Image detection method and device, readable medium and electronic equipment
US12508503B2 (en) Rendering processing method and electronic device
CN109814757B (en) Touch detection method and device, touch device, computer device and readable medium
CN108200416B (en) Coordinate mapping method, device and the projection device of projected image in projection device
US12347061B2 (en) Splitting and scaling images for input to a model and method, medium, and device therefor
US20180039378A1 (en) Touch-sensing device and touch-sensing method with unexpected-touch exclusion
CN112634201A (en) Target detection method and device and electronic equipment
US11100361B1 (en) Method and apparatus for processing feature point matching result
TW201513609A (en) Network visualization system and method
US10242495B2 (en) Method for adapting a mesh model of a geological subsurface
CN108564645B (en) Rendering method of house model, terminal device and medium
CN107168961B (en) Data display method and device for chart
WO2019085906A1 (en) Exposure calculation method and device, terminal, and readable storage medium
US20230316476A1 (en) Image splicing method and apparatus, and electonic device and computer-readable storage medium
AU2018203392B2 (en) Placemat: a ui for 2d/3d composition
CN115797182B (en) Feature map interpolation method, device, equipment and storage medium
CN110162728B (en) Method and device for determining scraping area ratio of electronic scraping card and electronic equipment
CN105447839A (en) Rectangular frame merging method and system
CN108803895A (en) Coordinate determination method, device and equipment
WO2017131629A1 (en) Merging object detections using graphs
CN108984262B (en) Three-dimensional pointer creating method and device and electronic equipment
CN105786833A (en) Webpage element collision judgment method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181113

RJ01 Rejection of invention patent application after publication