CN109947826A - A method of with big data technology building region portrait analysis model - Google Patents
A method of with big data technology building region portrait analysis model Download PDFInfo
- Publication number
- CN109947826A CN109947826A CN201910249179.7A CN201910249179A CN109947826A CN 109947826 A CN109947826 A CN 109947826A CN 201910249179 A CN201910249179 A CN 201910249179A CN 109947826 A CN109947826 A CN 109947826A
- Authority
- CN
- China
- Prior art keywords
- region
- data
- map
- population
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of method with big data technology building region portrait analysis model, belong to big data analysis and visualization technique field, the present invention takes the community or district in a region or selection fixation by arbitrarily drawing on map, it is for statistical analysis to resident population, working population, enterprise, infrastructure, public safety in the region etc. in real time, form intuitive statistical analysis.The model can quickly analyze in a certain region compare comprising population comprehensive analysis, movement of population trend, community, the region portrait of the labels such as social security, government related personnel can be effectively assisted to quickly understand each region situation of this city, in order to more rationally effectively carry out the progress of the work such as the people's livelihood, public security, resource allocation, convenience is provided for the personnel of government work, is preferably serviced for the common people.
Description
Technical field
The present invention relates to big data analysis and visualization techniques more particularly to a kind of utilization big data technology building region to draw
As the method for analysis model.
Background technique
The visual presentation that data relevant to region are carried out using map is in recent years in big data visualization technique
The combination of a kind of very common means, map and area data can the more intuitive rule for more really reflecting data.It is based on
The secondary development of the map also favor by many big data research staff, by invocation map provide API, according to oneself
Demand is customized exploitation, and preferably map can be combined with business scenario.With the increase of data volume, traditional relationship
Database computing capability can no longer meet the business scenario largely analyzed, therefore Data Migration is utilized into hadoop
The computing capability of spark carries out class to analysis scene and calculates in real time, is the popular method of big data field in recent years.
Community's grid-based management relies on unified city management and digitized platform, by city management area under one's jurisdiction according to one
Fixed standard is divided into unit grid.By reinforcing patrolling to the component and event of unit grid, a kind of supervision and place are established
Set form disconnected from each other.Main advantage for government is that government can actively discover, and is handled in time, and government pair is reinforced
The managerial ability and processing speed in city, by Resolving probiems before resident complains.The characteristics of to each grid, carries out deep
It dissects, obtains the characteristic of inhabitation, the personnel of work and enterprise in grid, administrative staff can be made to go deep into grasping each grid not
Same characteristic, and the crowd being directed in grid and enterprise formulate suitable policy, convenient for being efficiently managed to net region.
Summary of the invention
Based on factors above, the invention proposes a kind of sides with big data technology building region portrait analysis model
Method takes a region or the fixed community or district of selection by arbitrarily drawing on map, in real time to living in the region
Population, working population, enterprise, infrastructure, public safety etc. are for statistical analysis, form intuitive statistical analysis.The present invention
Can quickly analyze in a certain region compare comprising population comprehensive analysis, movement of population trend, community, the labels such as social security
Region portrait, can effectively assist government related personnel to quickly understand each region situation of this city, in order to more rationally effectively
The progress for carrying out the work such as the people's livelihood, public security, resource allocation, provides convenience for the personnel of government work, preferably services for the common people.
Particular content is as follows:
Map secondary development: the api interface that invocation map provides carries out secondary development, and area is freely drawn in realization on map
Domain, and the graphics process of drafting can be transmitted to backstage at the format of longitude and latitude.
It is warp to the corresponding address resolution such as population, company using map API on the basis of completing above technical scheme
Latitude, and save to database.
Data Migration and processing: data transfer tool Sqoop is utilized, by the population in relevant database, industry and commerce, social security
Etc. the address date of mass datas and parsing migrate to distributed memory system.
On the basis of completing above technical scheme, the ETL such as certain filtering, extraction operation is carried out to data, including logical
Calculating age date of birth is spent, using demographic data and social security data, by personnel and company's information, wage situation etc. is corresponded
Get up etc..
On the basis of completing above technical scheme, region portrait analysis model is established, a figure is drawn on map,
Or the latitude and longitude information of an area coordinate is put back in existing community district of selection etc., is designed and developed one and is judged a longitude and latitude
Point whether the algorithm in a map area, and filter out using the algorithm resident population and work people fallen in the area
Mouthful, it is for statistical analysis to the data for deleting choosing, complete region portrait index analysis.
On the basis of completing above technical scheme, the analysis of region portrait analysis model is obtained as a result, utilizing map skill
Art is shown on map with intuitive, diversified chart.
Obtain the mass datas such as population, social security, industrial and commercial information from public security system first, and by the mass data migrate to point
In cloth storage system HDFS, application distribution formula computing engines Spark is calculated in real time, copes with conventional relationship with this framework
Type database hypodynamic problem of operation under big data quantity, the analysis speed of lift scheme.Map is utilized to the data of storage
For API by household register information, occupancy information, the address conversion in company information is longitude and latitude, and is permanently stored in corresponding table, is
It is subsequent to judge whether population enterprise provides parameter in selected areas.It is first passed through on front-end map headed by the process of analysis
It draws and takes arbitrary region or select pre-set district and community, invocation map API obtains region vertex point coordinate information, will
Coordinate information processing is specific format and is transmitted to backstage, and background program calls the JDBC of distributed real time computation system spark
Interface, and it is passed to the coordinate information parameter in the region.Judge a coordinate whether in a region by independent development
UDF algorithm filters out the population in the region and enterprise, is counted to the data filtered out by pre-designed model
Analysis.
The beneficial effects of the invention are as follows
The community or district that a region or selection fixation are taken by arbitrarily drawing on map, in real time in the region
Resident population, working population, enterprise, infrastructure, public safety etc. are for statistical analysis, form intuitive statistical analysis.It can
With quickly analyze in a certain region compare comprising population comprehensive analysis, movement of population trend, community, the labels such as social security
Region portrait, can effectively assist government related personnel to quickly understand each region situation of this city, in order to more rationally effectively into
The progress of the work such as the row people's livelihood, public security, resource allocation provides convenience for the personnel of government work, preferably services for the common people.
Detailed description of the invention
Fig. 1 is workflow schematic diagram of the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments, based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
The technical solution adopted by the invention is as follows:
Map secondary development: the api interface that invocation map provides carries out secondary development, and area is freely drawn in realization on map
Domain, and the graphics process of drafting can be transmitted to backstage at the format of longitude and latitude.
It is warp to the corresponding address resolution such as population, company using map API on the basis of completing above technical scheme
Latitude, and save to database.
Data Migration and processing: data transfer tool Sqoop is utilized, by the population in relevant database, industry and commerce, social security
Etc. the address date of mass datas and parsing migrate to distributed memory system.
On the basis of completing above technical scheme, the ETL such as certain filtering, extraction operation is carried out to data, including logical
Calculating age date of birth is spent, using demographic data and social security data, by personnel and company's information, wage situation etc. is corresponded
Get up etc..
On the basis of completing above technical scheme, region portrait analysis model is established, a region is drawn on map
The latitude and longitude information of coordinate judges that longitude and latitude point whether in map area, and is filtered out using the algorithm and fallen in the area
Resident population and working population, it is for statistical analysis to the data for deleting choosing, complete region draw a portrait index analysis.
On the basis of completing above technical scheme, the analysis of region portrait analysis model is obtained as a result, utilizing map skill
Art is shown on map with intuitive, diversified chart.
As shown in Figure 1, process is as follows:
1, map drawing tool is developed；
2, population, enterprise, data such as social security and by Data Migration to distributed memory system are acquired；
3, address is parsed with map API, is latitude and longitude information by address resolution and saves；
4, exploitation carries out certain filtering to data, extracts, including calculates the age by the date of birth, utilizes demographic data
With social security data, by personnel and company's information, the one-to-one ETL script such as wage situation；
5, judge longitude and latitude point whether in map area；
6, according to the region latitude and longitude information of return, binding site falls into zone algorithm, obtain population in region, company, etc.
Data；
7, distributed-computation program is developed using spark；
8, using previous step distributed-computation program, the statistical analysis of region portrait is carried out in conjunction with calculated data；
9, calculated region portrait model data is drawn into displaying on map.
Need to develop herein judge a longitude and latitude point whether the UDF algorithm in a map area；The design of UDF algorithm
It is divided into two kinds of situations, one is coordinates whether in border circular areas, and one is coordinates in polygonal region.Wherein whether in circle
Algorithm in shape region judges according to the relationship of the distance and radius of circle of coordinate of ground point and central coordinate of circle, is less than the area radius Ze
In domain, it is on the contrary then not in region；Whether in polygonal region algorithm, using coordinate of ground point as vertex draw a line, this
Line with polygon side intersect, wherein if intersection point quantity be odd number if target point in polygonal region, if intersection
Point quantity is even number, then target point is outside polygonal region.
The foregoing is merely presently preferred embodiments of the present invention, is only used to illustrate the technical scheme of the present invention, and is not intended to limit
Determine protection scope of the present invention.Any modification, equivalent substitution, improvement and etc. done all within the spirits and principles of the present invention,
It is included within the scope of protection of the present invention.
Claims (10)
1. a kind of method with big data technology building region portrait analysis model, which is characterized in that
A region or the fixed community or district of selection are taken by arbitrarily drawing on map, in real time to living in the region
Population, working population, enterprise, infrastructure, public safety are for statistical analysis, form intuitive statistical analysis；Analyze this
Compare in regional comprising population comprehensive analysis, movement of population trend, community, the region of social security portrait.
2. the method according to claim 1, wherein
Mass data is obtained from public security system first, and the mass data is migrated into distributed memory system HDFS, is applied
Distributed computing engine Spark is calculated in real time.
3. according to the method described in claim 2, it is characterized in that,
To the data of storage using map API by household register information, occupancy information, the address conversion in company information is longitude and latitude,
And be permanently stored in corresponding table, judge whether population enterprise provides parameter in selected areas to be subsequent.
4. according to the method described in claim 3, it is characterized in that,
Arbitrary region or the pre-set district and community of selection, invocation map API is taken to obtain by drawing on front-end map
Region vertex point coordinate information is taken, coordinate information is handled as specific format and is transmitted to backstage, background program calls distributed real
When computing system spark JDBC interface, and be passed to the coordinate information parameter in the region；Judge that coordinate whether in region, sieves
The population in the region and enterprise are selected, it is for statistical analysis by pre-designed model to the data filtered out.
5. according to the method described in claim 4, it is characterized in that,
The api interface that invocation map provides carries out secondary development, realizes the free drawing area on map, and can will draw
Graphics process at the format of longitude and latitude be transmitted to backstage.
6. according to the method described in claim 5, it is characterized in that,
It is longitude and latitude to population, the corresponding address resolution of company using map API, and saves to database.
7. according to the method described in claim 6, it is characterized in that,
Using data transfer tool Sqoop, by the address date of mass data and parsing in relevant database migrate to
Distributed memory system.
8. the method according to the description of claim 7 is characterized in that
ETL operation is carried out to data, using demographic data and social security data, by personnel and company's information, wage situation one is a pair of
It should get up.
9. according to the method described in claim 8, it is characterized in that,
Region portrait analysis model is established, the latitude and longitude information of an area coordinate is drawn on map, judges that longitude and latitude point is
It is no to filter out the resident population and working population fallen in the area in map area, statistical is carried out to the data for deleting choosing
Region portrait index analysis is completed in analysis；The analysis of region portrait analysis model is obtained as a result, using Cartographic Technique, on map
It is shown with chart.
10. according to the method described in claim 9, it is characterized in that,
Operating procedure is as follows:
1) map drawing tool, is developed；
2) population, enterprise, data such as social security and by Data Migration to distributed memory system, are acquired；
3) address, is parsed with map API, is latitude and longitude information by address resolution and saves；
4), exploitation is filtered data, extracts, using demographic data and social security data, personnel and company's information one are a pair of
The ETL script that should get up；
5), judge longitude and latitude point whether in map area；
6), according to the region latitude and longitude information of return, binding site falls into zone algorithm, obtains population, company data in region；
7), distributed-computation program is developed using spark；
8), using previous step distributed-computation program, the statistical analysis of region portrait is carried out in conjunction with calculated data；
9) calculated region portrait model data, is drawn into displaying on map.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910249179.7A CN109947826A (en) | 2019-03-29 | 2019-03-29 | A method of with big data technology building region portrait analysis model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910249179.7A CN109947826A (en) | 2019-03-29 | 2019-03-29 | A method of with big data technology building region portrait analysis model |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109947826A true CN109947826A (en) | 2019-06-28 |
Family
ID=67013020
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910249179.7A Pending CN109947826A (en) | 2019-03-29 | 2019-03-29 | A method of with big data technology building region portrait analysis model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947826A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688439A (en) * | 2019-09-26 | 2020-01-14 | 杭州有数金融信息服务有限公司 | Method for automatically identifying and analyzing enterprise information based on regional geocoding |
| CN111598630A (en) * | 2020-06-30 | 2020-08-28 | 成都新潮传媒集团有限公司 | Cell portrait construction method and device and storage medium |
| CN112417273A (en) * | 2020-11-17 | 2021-02-26 | 平安科技（深圳）有限公司 | Region portrait image generation method, region portrait image generation device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663502A (en) * | 2012-03-29 | 2012-09-12 | 深圳市高正软件有限公司 | Method and system for real-time display of social management information |
| CN107103050A (en) * | 2017-03-31 | 2017-08-29 | 海通安恒（大连）大数据科技有限公司 | A big data modeling platform and method |
| CN107292787A (en) * | 2017-07-13 | 2017-10-24 | 山东浪潮云服务信息科技有限公司 | A kind of method that utilization Cartographic Technique builds school district pressure model |
| US9945981B2 (en) * | 2014-09-13 | 2018-04-17 | International Business Machines Corporation | Aggregation and analytics for application-specific optimization based on multiple data sources |
| CN108228772A (en) * | 2017-12-28 | 2018-06-29 | 北京航天云路有限公司 | A kind of method for visualizing of the crowd behaviour distribution based on GIS information |
-
2019
- 2019-03-29 CN CN201910249179.7A patent/CN109947826A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663502A (en) * | 2012-03-29 | 2012-09-12 | 深圳市高正软件有限公司 | Method and system for real-time display of social management information |
| US9945981B2 (en) * | 2014-09-13 | 2018-04-17 | International Business Machines Corporation | Aggregation and analytics for application-specific optimization based on multiple data sources |
| CN107103050A (en) * | 2017-03-31 | 2017-08-29 | 海通安恒（大连）大数据科技有限公司 | A big data modeling platform and method |
| CN107292787A (en) * | 2017-07-13 | 2017-10-24 | 山东浪潮云服务信息科技有限公司 | A kind of method that utilization Cartographic Technique builds school district pressure model |
| CN108228772A (en) * | 2017-12-28 | 2018-06-29 | 北京航天云路有限公司 | A kind of method for visualizing of the crowd behaviour distribution based on GIS information |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688439A (en) * | 2019-09-26 | 2020-01-14 | 杭州有数金融信息服务有限公司 | Method for automatically identifying and analyzing enterprise information based on regional geocoding |
| CN111598630A (en) * | 2020-06-30 | 2020-08-28 | 成都新潮传媒集团有限公司 | Cell portrait construction method and device and storage medium |
| CN112417273A (en) * | 2020-11-17 | 2021-02-26 | 平安科技（深圳）有限公司 | Region portrait image generation method, region portrait image generation device, computer equipment and storage medium |
| CN112417273B (en) * | 2020-11-17 | 2022-04-19 | 平安科技（深圳）有限公司 | Region portrait image generation method, region portrait image generation device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Yang et al. | EpiMob: Interactive visual analytics of citywide human mobility restrictions for epidemic control | |
| CN110489441B (en) | Big data-based ad hoc query method and equipment | |
| Marra et al. | From urban renewal to urban regeneration: Classification criteria for urban interventions. Turin 1995–2015: Evolution of planning tools and approaches | |
| CN113721892A (en) | Domain modeling method, domain modeling device, computer equipment and storage medium | |
| CN108446293A (en) | A method of based on urban multi-source isomeric data structure city portrait | |
| CN109947826A (en) | A method of with big data technology building region portrait analysis model | |
| CN110532337A (en) | Communal facility service ability method for improving towards intelligence community | |
| CN108388625A (en) | A kind of software in project cost management platform based on big data | |
| CN102750588A (en) | Sudden public health emergency response commanding and deciding system | |
| CN114063995A (en) | Development engine system and method based on managed pipe city visualization | |
| CN105913222A (en) | Intelligent business management method based on Internet big data | |
| CN106875131A (en) | A kind of dismantlement valuation allocation method and system | |
| Pan et al. | A dialectical system framework for green building assessment in high-density cities | |
| Liao et al. | An evolutionary note on smart city development in China | |
| Schiel | Migrant labour in contemporary South Africa | |
| CN111797083A (en) | A standardized basic geographic data production method and system | |
| Parsons et al. | The Australian Natural Disaster Resilience Index Volume I-State of Disaster Resilience Report | |
| Kahachi | Future cities and reality: Analytical preview of the different theories from information cities, smart cities, to liveable cities | |
| Almquist et al. | Point process models for household distributions within small areal units | |
| Perdikogianni et al. | Measuring diversity: a multi-variate analysis of land use and temporal patterning in Clerkenwell | |
| CN110267717A (en) | The method and device of auto zoom calling rule is automatically generated by different individually tenants in multi-tenant environment | |
| CN110928922A (en) | A public policy analysis model deployment method and system based on big data mining | |
| Pu et al. | The effect of big data analytics on firms sustainable competitive advantage of quality: A theory framework | |
| CN119359355B (en) | Road transportation market violation behavior situation sensing system and method thereof | |
| Jia | Intelligent Evaluation Method for Urban Public Space in the Big Data Era |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190628 |
|
| RJ01 | Rejection of invention patent application after publication |