[go: up one dir, main page]

CN116095351B - Information processing method, information processing device, electronic device and storage medium - Google Patents

Information processing method, information processing device, electronic device and storage medium

Info

Publication number
CN116095351B
CN116095351B CN202310063597.3A CN202310063597A CN116095351B CN 116095351 B CN116095351 B CN 116095351B CN 202310063597 A CN202310063597 A CN 202310063597A CN 116095351 B CN116095351 B CN 116095351B
Authority
CN
China
Prior art keywords
data
http
information processing
http request
enhancement information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310063597.3A
Other languages
Chinese (zh)
Other versions
CN116095351A (en
Inventor
罗汶龙
马军
罗晓华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Netease Zaigu Technology Co Ltd
Original Assignee
Hangzhou Netease Zaigu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Netease Zaigu Technology Co Ltd filed Critical Hangzhou Netease Zaigu Technology Co Ltd
Priority to CN202310063597.3A priority Critical patent/CN116095351B/en
Publication of CN116095351A publication Critical patent/CN116095351A/en
Application granted granted Critical
Publication of CN116095351B publication Critical patent/CN116095351B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348Demultiplexing of additional data and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4355Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Embodiments of the present disclosure relate to the field of computer technology, and more particularly, to an information processing method, an information processing apparatus, an electronic device, and a storage medium. The information processing method comprises the steps of obtaining supplemental enhancement information data from a video code stream, converting the supplemental enhancement information data into HTTP format data, storing the HTTP format data into a cache, wherein the HTTP format data comprises HTTP request data and corresponding HTTP response data, the HTTP format data is used for executing an HTTP request response flow, and the HTTP request response flow comprises the steps of sending the HTTP request data and receiving the corresponding HTTP response data. According to the information processing method, the supplementary enhancement information data are converted into HTTP format data for being acquired by the packet grabbing tool, so that the supplementary enhancement information data can be displayed clearly, durably and in multiple dimensions, the threshold for checking the supplementary enhancement information data is reduced, and the efficiency of development and problem solving is improved.

Description

Information processing method, information processing apparatus, electronic device, and storage medium
Technical Field
Embodiments of the present disclosure relate to the field of information processing technology, and more particularly, to an information processing method, an information processing apparatus, an electronic device, and a storage medium.
Background
This section is intended to provide a background or context for embodiments of the present disclosure and the description herein is not admitted to be prior art by inclusion in this section.
In the live broadcast field, the most basic and important is the interactive real-time property. Taking an e-commerce as an example, when a commodity is put on or taken off a shelf, red packets are pushed, live broadcast parameters are dynamically adjusted, and the like, and a user side is interacted strongly, the time of a mouth broadcast and an interaction instruction of a host is required to be matched, so that a supplementary enhancement information technology in streaming media is required, the supplementary enhancement information can be inserted into a video code stream to be integrated with a video, and when the live broadcast video is played, the parsed supplementary enhancement information data is submitted to service processing to realize zero-delay interaction. However, the supplemental enhancement information data fused in the code stream has opacity, and can not be well reserved along with the flash of live broadcast, so that the supplemental enhancement information data is very unfriendly to the examination problems in the development and test processes, and the problems can not be completely reproduced after the live broadcast environment is changed, which clearly increases the labor cost and reduces the efficiency of developing and solving the problems.
Disclosure of Invention
In this context, embodiments of the present invention desirably provide an information processing method, an information processing apparatus, an electronic device, and a storage medium.
At least one embodiment of the present disclosure provides an information processing method, which includes obtaining supplemental enhancement information data from a video bitstream, converting the supplemental enhancement information data into HTTP format data, storing the HTTP format data in a cache, the HTTP format data including HTTP request data and corresponding HTTP response data, the HTTP format data being used to execute an HTTP request response procedure, the HTTP request response procedure including transmitting the HTTP request data and receiving the corresponding HTTP response data.
For example, in an information processing method provided in at least one embodiment of the present disclosure, before converting supplemental enhancement information data into HTTP-format data, the method includes classifying the supplemental enhancement information data by traffic.
For example, in an information processing method provided in at least one embodiment of the present disclosure, HTTP request data includes a URL including information parameters of supplemental enhancement information data and a message header including environment data of the supplemental enhancement information data, and HTTP response data includes the supplemental enhancement information data.
For example, in the information processing method provided in at least one embodiment of the present disclosure, the URL further includes a URL protocol name and an internal server ip address, the information parameter of the supplementary enhancement information data includes a supplementary enhancement information service name and a supplementary enhancement information instruction, and the environment data of the supplementary enhancement information data includes device information, a live broadcast parameter, and a user ID.
For example, in an information processing method provided in at least one embodiment of the present disclosure, HTTP request data and HTTP response data are stored in a buffer in a pair-wise manner, and an HTTP request response flow includes sending the HTTP request data to an internal server, and receiving corresponding HTTP response data obtained by the internal server from the buffer according to the HTTP request data.
For example, in an information processing method provided by at least one embodiment of the present disclosure, HTTP response data is stored in a cache in JSON format.
For example, in the information processing method provided in at least one embodiment of the present disclosure, the information processing method is applied to a video client, and a network proxy of the video client is configured to obtain an ip address and a port provided by a packet capturing tool, so that the packet capturing tool obtains HTTP format data transmitted in an HTTP request response flow.
For example, in an information processing method provided in at least one embodiment of the present disclosure, a video client and a packet capturing tool are located in the same network.
For example, in an information processing method provided in at least one embodiment of the present disclosure, HTTP format data transmitted in an HTTP request response flow is provided for a packet grabbing tool to acquire.
The method comprises the steps of sending HTTP request data to an internal server, receiving corresponding HTTP response data obtained by the internal server from a cache according to the HTTP request data, converting the HTTP request data and the HTTP response data in the cache based on supplemental enhancement information data obtained from a video code stream, and transmitting the HTTP request data and the HTTP response data between the internal server for a packet grabbing tool to obtain.
At least one embodiment of the present disclosure provides an information processing apparatus, which includes an acquisition module configured to acquire supplemental enhancement information data from a video bitstream, a conversion module configured to convert the supplemental enhancement information data into HTTP format data, and a storage module configured to store the HTTP format data in a cache, the HTTP format data including HTTP request data and corresponding HTTP response data, the HTTP format data being used to execute an HTTP request response procedure, the HTTP request response procedure including transmitting the HTTP request data and receiving the corresponding HTTP response data.
For example, at least one embodiment of the present disclosure provides for the information processing apparatus to further include a classification module configured to classify the supplemental enhancement information data by service.
For example, in an information processing apparatus provided in at least one embodiment of the present disclosure, HTTP request data includes a URL including information parameters of supplemental enhancement information data and a message header including environment data of the supplemental enhancement information data, and HTTP response data includes the supplemental enhancement information data.
For example, in the information processing apparatus provided in at least one embodiment of the present disclosure, the URL further includes a URL protocol name and an internal server ip address, the information parameter of the supplementary enhancement information data includes a supplementary enhancement information service name and a supplementary enhancement information instruction, and the environment data of the supplementary enhancement information data includes device information, a live broadcast parameter, and a user ID.
For example, in the information processing apparatus provided in at least one embodiment of the present disclosure, the HTTP request data and the HTTP response data are stored in the buffer in a pair-wise manner, and the information processing apparatus further includes an HTTP request response module configured to transmit the HTTP request data to the internal server, and receive the corresponding HTTP response data acquired from the buffer by the internal server according to the HTTP request data.
For example, in an information processing apparatus provided in at least one embodiment of the present disclosure, HTTP response data is stored in a cache in JSON format.
For example, in the information processing apparatus provided in at least one embodiment of the present disclosure, the information processing apparatus is applied to a video client, and a network proxy of the video client is configured to provide an ip address and a port for the packet capturing tool to obtain HTTP format data transmitted in an HTTP request response flow.
For example, in an information processing apparatus provided in at least one embodiment of the present disclosure, a video client and a packet capture tool are located in the same network.
For example, in an information processing apparatus provided in at least one embodiment of the present disclosure, HTTP format data transmitted in an HTTP request response flow is provided for a packet grabbing tool to acquire.
At least one embodiment of the present disclosure provides an information processing apparatus, which includes an HTTP request response module configured to send HTTP request data to an internal server, and receive corresponding HTTP response data obtained by the internal server from a cache according to the HTTP request data, where the HTTP request data and the HTTP response data in the cache are obtained based on conversion of supplemental enhancement information data obtained from a video bitstream, and the HTTP request data and the HTTP response data transmitted between the internal server are obtained by a packet grabbing tool.
At least one embodiment of the present disclosure provides an electronic device comprising a processor, a memory having stored therein executable instructions of the processor, the processor being configured to perform the steps of the information processing method provided by at least one embodiment of the present disclosure via execution of the executable instructions.
At least one embodiment of the present disclosure provides a computer-readable storage medium storing a program that, when executed, implements the steps of the information processing method provided by at least one embodiment of the present disclosure.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
The information processing method, the information processing device, the electronic equipment and the computer readable storage medium have the following beneficial effects:
the supplemental enhancement information data can be clearly, permanently and multi-dimensionally displayed visually by converting the supplemental enhancement information data into HTTP format data for the packet grabbing tool to acquire, so that the threshold for checking the supplemental enhancement information data is reduced, and the efficiency of development and problem solving is improved.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:
fig. 1 schematically shows an application architecture diagram according to the related art;
FIG. 2 schematically illustrates one of the flowcharts of the information processing method according to the embodiment of the present disclosure;
FIG. 3 schematically illustrates one of the information handling system architecture diagrams according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a second flowchart of an information processing method according to an embodiment of the present disclosure;
FIG. 5 schematically illustrates a second information handling system architecture diagram according to an embodiment of the present disclosure;
Fig. 6 schematically shows one of block diagrams of an information processing apparatus according to an embodiment of the present disclosure;
FIG. 7 schematically shows a second block diagram of an information processing apparatus according to an embodiment of the present disclosure;
FIG. 8 shows a schematic diagram of a storage medium according to an embodiment of the present disclosure, and
Fig. 9 schematically shows a block diagram of an electronic device according to a disclosed embodiment.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are presented merely to enable those skilled in the art to better understand and practice the invention and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Those skilled in the art will appreciate that embodiments of the present disclosure may be implemented as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of entirely hardware, entirely software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software.
According to an embodiment of the present disclosure, there are provided an information processing method, an information processing apparatus, an electronic device, and a storage medium.
Any number of elements in the figures are for illustration and not limitation, and any naming is used for distinction only, and not for any limiting sense.
The principles and spirit of the present disclosure are described in detail below with reference to several representative embodiments thereof.
Summary of The Invention
In practice, the inventor finds that the supplemental enhancement information (Supplemental Enhancement Information, SEI) fused in the video code stream has opacity, and as live broadcast is fast, the supplemental enhancement information data cannot be well reserved, so that the supplemental enhancement information is very unfriendly to the investigation problem in the development and test processes, when the problem occurs, a plurality of parties are required to examine logs or simulate live broadcast again, but after the live broadcast environment is changed, the problem cannot be completely reproduced, thus increasing a great amount of labor cost and reducing the efficiency of developing and solving the problem.
In the live broadcast process, a live broadcast software development kit (Software Development Kit, SDK) exposes the supplementary enhancement information data to a defined interface through analyzing a code stream, a service end realizes a callback interface for analyzing and exposing the supplementary enhancement information data, and the supplementary enhancement information data is output as a supplementary enhancement information data log in a character string mode.
However, in this related art, the supplemental enhancement information data log is integrated with the system log and the application log, and as shown in fig. 1, the supplemental enhancement information data log is stored in the log system together with the application non-live log, the system log and other application logs. Moreover, with long-time running log accumulation, when the cached log exceeds the set log cache size, the earlier data can be automatically cleaned. Therefore, this related art has the following drawbacks:
1. The supplemental enhancement information data log is intermixed with other logs, requiring filtering to obtain the desired supplemental enhancement information data log.
2. The supplemental enhancement information data log cannot be viewed permanently, and there is a risk of being deleted after the log memory exceeds a set size.
3. The supplemental enhancement information data and the running environment information cannot be aggregated together, and it is difficult to restore the running environment when the supplemental enhancement information data is delivered.
4. The threshold for checking the supplementary enhancement information data log is high, and for non-developers, the development environment needs to be installed and configured, and knowledge related to the checking log is learned.
On the basis of finding the technical problems, the inventor proposes an exemplary embodiment of the disclosure, and the invention is based on the idea that supplemental enhancement information data is dynamically acquired, the supplemental enhancement information data is converted into HTTP format data, the HTTP format data is used for executing an HTTP request response flow, the HTTP request response flow comprises sending HTTP request data and receiving corresponding HTTP response data, HTTP format data transmitted in the HTTP request response flow is provided for a packet grabbing tool to acquire, and the packet grabbing tool displays the supplemental enhancement information data included in the HTTP format data.
According to the information processing method provided by the embodiment of the disclosure, the video client is combined with the packet grabbing tool, the supplementary enhancement information data log is separated from the system log, the supplementary enhancement information data is converted into HTTP format data, and then the supplementary enhancement information data is independently displayed through the packet grabbing tool, so that the supplementary enhancement information data can be clearly, durably and multi-dimensionally visually displayed. Moreover, the information processing method provided by the embodiment of the disclosure can facilitate non-developers to check the supplementary enhancement information data, and does not need to configure development environments and write command lines. In addition, the information processing method provided by the embodiment of the disclosure can improve the positioning and solving capabilities of the problems related to the supplemental enhancement information data, reduce the communication cost and improve the efficiency of developing and solving the problems.
Having described the basic principles of the present invention, various non-limiting embodiments of the invention are described in detail below.
Exemplary method
An information processing method according to an exemplary embodiment of the present disclosure will be described below with reference to the accompanying drawings.
For ease of understanding, several terms are explained below that relate to embodiments of the present disclosure.
Code stream
The code stream refers to the number of times the communication port changes in high and low levels when transmitting data within 1 second, and is also referred to as code rate. The more data is transmitted per unit time, the more information is contained, and the most important part of picture quality control in video coding.
Supplemental enhancement information
The supplemental enhancement information belongs to the category of code streams, provides a method for adding additional information into the video code stream, and is one of the characteristics of video compression standards such as H.264/H.265.
URL
I.e. uniform resource locator, commonly known as web address, web address for short, is the address of a standard resource on the internet, like a house number on a network.
Bag grabbing tool
The packet grasping tool is software for intercepting and viewing the content of the network data packet. By analyzing the captured data packets, useful information can be obtained. In application program development, network behavior needs to be monitored and tested, and network and safety related problems are checked.
HTTP request
The HTTP request is issued by the client to a named host located on the server. The purpose of the request is to access a resource on the server.
HTTP response
The server sends an HTTP response to the client. The purpose of the response is to provide the client with the resources it has requested, or to inform the client that the action it has requested has been performed, or to inform the client that an error has occurred in processing its request.
Internal server
A server that is started internally by the application after the application is opened is specified.
JSON
JSON is a lightweight data exchange format. It stores and presents data in a text format that is completely independent of the programming language, based on a subset of ECMAScript (js specification formulated by the european computer institute). The compact and clear hierarchical structure makes JSON an ideal data exchange language. The method is easy to read and write, easy to analyze and generate by a machine, and effectively improves the network transmission efficiency.
User agent
A User Agent (UA) is a special string header that enables a server to identify the operating system and version, CPU type, browser and version, browser rendering engine, browser language, browser plug-in, etc. used by a client.
Fig. 2 is a schematic flow chart of an information processing method according to at least one embodiment of the present disclosure.
As shown in FIG. 2, the information processing method includes the following steps S201 to S203.
Step S201, obtaining supplemental enhancement information data from the video bitstream.
For example, after the video client is started, the supplemental enhancement information data interface is parsed by the software development kit to obtain supplemental enhancement information data.
And step S202, the supplementary enhancement information data are converted into HTTP format data.
For example, the HTTP format data includes HTTP request data and corresponding HTTP response data. The HTTP request data comprises a URL and a message header, the URL is combined according to a URL specification structure and is responsible for requesting an internal server through a domain name, and the message header provides support for log expansion environment data.
For example, in some embodiments of the present disclosure, the URL includes information parameters of the supplemental enhancement information data, the message header includes context data of the supplemental enhancement information data, and the HTTP response data includes the supplemental enhancement information data.
For example, in some embodiments of the present disclosure, the URL further includes a URL protocol name and an internal server ip address, the information parameters of the supplemental enhancement information data include a supplemental enhancement information service name and a supplemental enhancement information instruction, and the environment data of the supplemental enhancement information data includes device information, live parameters, and a user ID.
For example, the supplementary enhancement information service name includes live (representing supplementary enhancement information related to live), game (representing supplementary enhancement information related to game), alert (representing supplementary enhancement information related to dynamic tune), and the like. The supplementary enhancement information instruction is an instruction number that corresponds to a service to be executed, for example, command=100 indicates that the commodity is put on shelf, and for example, command=200 indicates that the commodity is put off shelf, and so on. The supplemental enhancement information instruction may support multiple parameters separated by a symbol "≡".
The URL of the HTTP request data is illustrated below by table 1.
TABLE 1
The header of HTTP request data is illustrated by table 2 below.
TABLE 2
The URL and the message header in the HTTP request data are used for recording the equipment information, the live broadcast parameters and the user information together in the packet capturing tool when the supplemental enhancement information is issued, the supplemental enhancement information data are enriched, and the multidimensional supplemental enhancement information data are formed.
And step S203, storing the HTTP format data into a cache.
For example, in some embodiments of the present disclosure, HTTP request data and HTTP response data are stored in pairs in a cache. That is, corresponding HTTP response data may be acquired in the cache according to the HTTP request data.
For example, in some embodiments of the present disclosure, HTTP formatted data is used to perform an HTTP request response procedure, which may include steps S1 and S2:
step S1, HTTP request data is sent to an internal server;
and step S2, receiving corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data.
For example, HTTP formatted data transmitted in the HTTP request response flow is available for the packet grabbing tool to acquire. For example, a common bag-grasping tool may include WIRESHARK, CHARLES, FIDDLER, QPA, SNOOP, etc. The supplemental enhancement information data is converted into HTTP format data for being acquired by a packet grabbing tool, the capacity of the packet grabbing tool for grabbing HTTP format data and the strong display capacity can be multiplexed, and the functions related to data display do not need to be repeatedly developed. The HTTP format data is acquired by the packet grabbing tool, the supplemental enhancement information data can be recorded in a lasting mode without depending on a log system, the risk of deleting the data is eliminated, and the acquired supplemental enhancement information data can be always saved under the condition that the packet grabbing tool is not closed.
For example, in some embodiments of the present disclosure, HTTP response data is stored in a cache in JSON format. Because the JSON format is easy to read and write and easy to machine analyze and generate, the HTTP response data is stored in the cache in the JSON format, so that the network transmission efficiency can be effectively improved.
For example, in some embodiments of the present disclosure, the above-described information processing method is applied to a video client. For example, the video client and the packet capturing tool are located in the same network, and the network proxy of the video client is configured to provide the ip address and port for the packet capturing tool to obtain HTTP format data transmitted in the HTTP request response flow.
The package grabbing tool is utilized to conveniently view the supplementary enhancement information data, a development environment and a writing command line are not required to be configured, and a threshold for viewing the supplementary enhancement information data is reduced.
For example, in some embodiments of the present disclosure, before step S202, the information processing method provided by the embodiments of the present disclosure may include classifying the supplemental enhancement information data by service.
For example, live related supplemental enhancement information data is classified into one type, game related supplemental enhancement information data is classified into one type, dynamic tuning related supplemental enhancement information data is classified into one type, and so on.
Fig. 3 illustrates an architecture of an information processing system according to an exemplary embodiment of the present disclosure, as shown in fig. 3, an HTTP request response procedure is performed in an application program of a video client, and HTTP format data transmitted in the HTTP request response procedure is acquired by a packet capture tool. Application non-live logs, system logs, and other application logs other than the supplemental enhancement information data log are stored in the log system.
The information processing method shown in fig. 2 is specifically described below with reference to fig. 3.
Firstly, a video client is started, a supplemental enhancement information data interface is analyzed, and SEI data is obtained from a video code stream. And then, classifying the SEI data according to the service by an SEI processor to obtain classified SEI data. And then, converting the classified SEI data into HTTP format data, wherein the HTTP format data comprises HTTP request data and corresponding HTTP response data, the HTTP request data comprises a URL and a message header, and the HTTP response data comprises SEI data. The HTTP request data and HTTP response data are then stored in a cache (not shown in fig. 3), where the HTTP response data is stored in JSON format. Then, the application program sends HTTP request data to the internal server, receives corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data, namely, completes an HTTP request response flow, and in the HTTP request response flow, the packet grabbing tool obtains HTTP format data transmitted in the HTTP request response flow, so that SEI data can be seen at the packet grabbing tool.
Fig. 4 is a schematic flow chart of another information processing method provided by at least one embodiment of the present disclosure.
As shown in FIG. 4, the information processing method includes the following steps S401 to S402.
Step S401, HTTP request data is sent to an internal server.
Step S402, corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data is received.
For example, the HTTP request data and the HTTP response data in the cache are obtained based on the supplemental enhancement information data obtained from the video bitstream, and the HTTP request data and the HTTP response data transmitted between the internal server are obtained by the packet grabbing tool.
Fig. 5 illustrates another architecture of an information processing system according to an exemplary embodiment of the present disclosure, as shown in fig. 5, an application program sends HTTP request data to an internal server, the internal server obtains corresponding HTTP response data from a cache according to the HTTP request data, and the application program receives the obtained HTTP response data from the internal server.
For the internal server, after the video client is started, the client is started through the ip address and the port provided by the packet capturing tool, HTTP request data sent by the application program is waited, after the HTTP request data is received, corresponding HTTP response data is obtained from the cache, and the HTTP response data is returned to the application program, namely, one HTTP request response flow is completed.
Exemplary apparatus
Having introduced the information processing method of the exemplary embodiment of the present disclosure, next, the information processing apparatus of the exemplary embodiment of the present disclosure is described with reference to fig. 6 and 7.
Fig. 6 illustrates an information processing apparatus 600 provided by at least one embodiment of the present disclosure. The information processing apparatus 600 may be used to perform the information processing method shown in fig. 2.
As shown in fig. 6, the information processing apparatus 600 may include an acquisition module 601, a conversion module 602, and a storage module 603.
The acquisition module 601 is configured to acquire supplemental enhancement information data from a video bitstream.
The translation module 602 is configured to translate the supplemental enhancement information data into HTTP formatted data.
The storage module 603 is configured to store HTTP formatted data in a cache.
For example, the HTTP format data includes HTTP request data and corresponding HTTP response data, the HTTP format data is used to execute an HTTP request response procedure, and the HTTP request response procedure includes sending the HTTP request data and receiving the corresponding HTTP response data.
For example, in some embodiments of the present disclosure, the information processing apparatus 600 may further include a classification module 604. The classification module 604 is configured to classify the supplemental enhancement information data by traffic. For example, classification module 604 is the SEI processor above.
For example, in some embodiments of the present disclosure, the HTTP request data may include a URL, which may include information parameters of the supplemental enhancement information data, and a message header, which may include context data of the supplemental enhancement information data, which may include the supplemental enhancement information data.
For example, in some embodiments of the present disclosure, the URL may further include a URL protocol name and an internal server ip address, the information parameters of the supplemental enhancement information data may include a supplemental enhancement information service name and a supplemental enhancement information instruction, and the environment data of the supplemental enhancement information data may include device information, live parameters, and a user ID.
For example, in some embodiments of the present disclosure, the HTTP request data and the HTTP response data are stored in pairs in a buffer, and the information processing apparatus 600 may further include an HTTP request response module 605. The HTTP request response module 605 is configured to send HTTP request data to the internal server, and receive corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data.
For example, in some embodiments of the present disclosure, HTTP response data is stored in a cache in JSON format.
For example, in some embodiments of the present disclosure, the information processing apparatus 600 is applied to a video client, where a network proxy of the video client is configured to capture an ip address and a port provided by a packet capturing tool, so that the packet capturing tool can obtain HTTP format data transmitted in an HTTP request response flow.
For example, in some embodiments of the present disclosure, the video client is located in the same network as the packet-grabbing tool.
For example, in some embodiments of the present disclosure, HTTP formatted data transmitted in the HTTP request response flow is available for retrieval by the packet-grabbing tool.
For example, the information processing apparatus 600 may be implemented in hardware, software, firmware, and any feasible combination thereof, which is not limited by the present disclosure.
The technical effects of the information processing apparatus 600 are the same as those of the information processing method described above, and will not be described in detail here.
Fig. 7 illustrates another information processing apparatus 700 provided by at least one embodiment of the present disclosure. The information processing apparatus 700 may be used to perform the information processing method shown in fig. 4.
As shown in fig. 7, the information processing apparatus 700 may include an HTTP request response module 605.
The HTTP request response module 605 is configured to send HTTP request data to the internal server, and to receive corresponding HTTP response data that the internal server obtains from the cache based on the HTTP request data.
For example, the HTTP request data and the HTTP response data in the cache are obtained based on the supplemental enhancement information data obtained from the video bitstream, and the HTTP request data and the HTTP response data transmitted between the internal server are obtained by the packet grabbing tool.
For example, the information processing apparatus 700 may be implemented in hardware, software, firmware, and any feasible combination thereof, which is not limited by the present disclosure.
The technical effects of the information processing apparatus 700 are the same as those of the information processing method described above, and will not be described again here.
Exemplary storage Medium
Having described the information processing method of the exemplary embodiment of the present disclosure and the apparatus thereof, next, a storage medium of the exemplary embodiment of the present disclosure will be described with reference to fig. 8.
Referring to fig. 8, a program product 800 for implementing the above-described method according to an embodiment of the present disclosure is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of a readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
Exemplary electronic device
Having described the storage medium of the exemplary embodiments of the present disclosure, next, an electronic device of the exemplary embodiments of the present disclosure will be described with reference to fig. 9.
The electronic device 900 shown in fig. 9 is merely an example and should not be construed to limit the functionality and scope of use of embodiments of the present disclosure in any way.
As shown in fig. 9, the electronic device 900 is embodied in the form of a general purpose computing device. The components of the electronic device 900 may include, but are not limited to, the at least one processing unit 910 described above, the at least one storage unit 920 described above, a bus 930 connecting the different system components (including the storage unit 920 and the processing unit 910), and a display unit 940.
Wherein the storage unit stores program code that is executable by the processing unit 910 such that the processing unit 910 performs steps according to various exemplary embodiments of the present invention described in the above-described "exemplary methods" section of the present specification. For example, the processing unit 910 may perform the steps as shown in fig. 2 or 4.
The storage unit 920 may include volatile storage units such as a random access storage unit (RAM) 921 and/or a cache storage unit 922, and may further include a read only storage unit (ROM) 923.
The storage unit 920 may also include a program/utility 924 having a set (at least one) of program modules 925, such program modules 925 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 930 may include a data bus, an address bus, and a control bus.
The electronic device 900 may also communicate with one or more external devices 901 (e.g., keyboard, pointing device, bluetooth device, etc.) via an input/output (I/O) interface 950. The electronic device 900 also includes a display unit 940 that is connected to an input/output (I/O) interface 950 for displaying. Also, electronic device 900 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 960. As shown, the network adapter 960 communicates with other modules of the electronic device 900 over the bus 930. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 900, including, but not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
It should be noted that although in the above detailed description several modules or sub-modules of an information processing apparatus are mentioned, such a division is only exemplary and not mandatory. Indeed, the features and functionality of two or more units/modules described above may be embodied in one unit/module in accordance with embodiments of the present disclosure. Conversely, the features and functions of one unit/module described above may be further divided into ones that are embodied by a plurality of units/modules.
Furthermore, although the operations of the methods of the present disclosure are depicted in the drawings in a particular order, this is not required or suggested that these operations must be performed in this particular order or that all of the illustrated operations must be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.
While the spirit and principles of the present invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments nor does it imply that features of the various aspects are not useful in combination, nor are they useful in any combination, such as for convenience of description. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (20)

1. An information processing method, characterized by comprising:
Acquiring supplementary enhancement information data from a video code stream;
converting the supplemental enhancement information data into HTTP formatted data;
Storing the HTTP format data into a cache so that a packet grabbing tool can acquire the HTTP format data transmitted in an HTTP request response flow, and visually displaying supplementary enhancement information data contained in the HTTP format data according to an independent form by the packet grabbing tool;
The HTTP format data comprises HTTP request data and corresponding HTTP response data, the HTTP format data is used for executing the HTTP request response flow, and the HTTP request response flow comprises the steps of sending the HTTP request data and receiving the corresponding HTTP response data.
2. The information processing method according to claim 1, characterized by comprising, before converting the supplemental enhancement information data into HTTP format data:
and classifying the supplementary enhancement information data according to the service.
3. The information processing method according to claim 1, wherein,
The HTTP request data comprises a URL and a message header, the URL comprises information parameters of the supplemental enhancement information data, the message header comprises environment data of the supplemental enhancement information data, and the HTTP response data comprises the supplemental enhancement information data.
4. An information processing method according to claim 3, wherein the URL further includes a URL protocol name and an internal server ip address, the information parameter of the supplementary enhancement information data includes a supplementary enhancement information service name and a supplementary enhancement information instruction, and the environment data of the supplementary enhancement information data includes device information, a live broadcast parameter, and a user ID.
5. The information processing method according to claim 1, wherein the HTTP request data and the HTTP response data are stored in the buffer in pairs, the HTTP request response flow including:
Sending the HTTP request data to an internal server;
and receiving corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data.
6. The information processing method according to claim 1, wherein the HTTP response data is stored in the cache in JSON format.
7. The information processing method according to claim 1, wherein the information processing method is applied to a video client, and a network proxy of the video client is configured to provide an ip address and a port for a packet capturing tool to obtain HTTP format data transmitted in the HTTP request response flow.
8. The information processing method according to claim 7, wherein the video client and the packetizing tool are located in the same network.
9. An information processing method, characterized by comprising:
sending HTTP request data to an internal server;
receiving corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data,
The HTTP request data and the HTTP response data in the cache are obtained based on the conversion of the supplemental enhancement information data obtained from the video code stream, the HTTP format data comprises the HTTP request data and the HTTP response data, the HTTP format data is obtained by a packet grabbing tool, and the supplemental enhancement information data in the HTTP format data is visually displayed by the packet grabbing tool according to an independent form.
10. An information processing apparatus, characterized by comprising:
the acquisition module is configured to acquire the supplementary enhancement information data from the video code stream;
a conversion module configured to convert the supplemental enhancement information data into HTTP formatted data;
The storage module is configured to store the HTTP format data into a cache so that a packet grabbing tool can acquire the HTTP format data transmitted in the HTTP request response flow and visually display the supplementary enhancement information data contained in the HTTP format data in an independent form;
The HTTP format data comprises HTTP request data and corresponding HTTP response data, the HTTP format data is used for executing the HTTP request response flow, and the HTTP request response flow comprises the steps of sending the HTTP request data and receiving the corresponding HTTP response data.
11. The information processing apparatus according to claim 10, further comprising a classification module configured to classify the supplemental enhancement information data by service.
12. The information processing apparatus according to claim 10, wherein,
The HTTP request data comprises a URL and a message header, the URL comprises information parameters of the supplemental enhancement information data, the message header comprises environment data of the supplemental enhancement information data, and the HTTP response data comprises the supplemental enhancement information data.
13. The information processing apparatus according to claim 12, wherein the URL further includes a URL protocol name and an internal server ip address, the information parameter of the supplementary enhancement information data includes a supplementary enhancement information service name and a supplementary enhancement information instruction, and the environment data of the supplementary enhancement information data includes device information, a live broadcast parameter, a user ID.
14. The information processing apparatus according to claim 10, wherein the HTTP request data and the HTTP response data are stored in the buffer in pairs, the information processing apparatus further comprising an HTTP request response module configured to:
Sending the HTTP request data to an internal server;
and receiving corresponding HTTP response data obtained by the internal server from the cache according to the HTTP request data.
15. The information processing apparatus according to claim 10, wherein the HTTP response data is stored in the cache in JSON format.
16. The information processing apparatus according to claim 10, wherein the information processing apparatus is applied to a video client, and a network proxy of the video client is configured to provide an ip address and a port for the packet capturing tool to obtain HTTP format data transmitted in the HTTP request response flow.
17. The information processing apparatus of claim 16, wherein the video client is located in the same network as the packetizing tool.
18. An information processing apparatus is characterized by comprising an HTTP request response module configured to send HTTP request data to an internal server, and to receive corresponding HTTP response data acquired from a cache by the internal server according to the HTTP request data,
The HTTP request data and the HTTP response data in the cache are obtained based on the conversion of the supplemental enhancement information data obtained from the video code stream, the HTTP format data comprises the HTTP request data and the HTTP response data, the HTTP format data is obtained by a packet grabbing tool, and the supplemental enhancement information data in the HTTP format data is visually displayed by the packet grabbing tool according to an independent form.
19. An electronic device, comprising:
A processor;
A memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the information processing method of any one of claims 1 to 9 via execution of the executable instructions.
20. A computer-readable storage medium storing a program, characterized in that the program when executed implements the steps of the information processing method according to any one of claims 1 to 9.
CN202310063597.3A 2023-01-13 2023-01-13 Information processing method, information processing device, electronic device and storage medium Active CN116095351B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310063597.3A CN116095351B (en) 2023-01-13 2023-01-13 Information processing method, information processing device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310063597.3A CN116095351B (en) 2023-01-13 2023-01-13 Information processing method, information processing device, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN116095351A CN116095351A (en) 2023-05-09
CN116095351B true CN116095351B (en) 2025-09-26

Family

ID=86207929

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310063597.3A Active CN116095351B (en) 2023-01-13 2023-01-13 Information processing method, information processing device, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN116095351B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8332469B1 (en) * 2010-10-06 2012-12-11 Google Inc. Web resource caching
CN103069828A (en) * 2010-07-20 2013-04-24 高通股份有限公司 Providing sequence data sets for streaming video data
WO2022116770A1 (en) * 2020-12-01 2022-06-09 上海连尚网络科技有限公司 Streaming media video playback and generation methods, and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101398319B1 (en) * 2011-04-15 2014-05-22 스카이파이어 랩스, 인크. Real-time video detector
US10228955B2 (en) * 2016-09-29 2019-03-12 International Business Machines Corporation Running an application within an application execution environment and preparation of an application for the same
CN112003945A (en) * 2020-08-26 2020-11-27 杭州迪普科技股份有限公司 Service request response method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103069828A (en) * 2010-07-20 2013-04-24 高通股份有限公司 Providing sequence data sets for streaming video data
US8332469B1 (en) * 2010-10-06 2012-12-11 Google Inc. Web resource caching
WO2022116770A1 (en) * 2020-12-01 2022-06-09 上海连尚网络科技有限公司 Streaming media video playback and generation methods, and device

Also Published As

Publication number Publication date
CN116095351A (en) 2023-05-09

Similar Documents

Publication Publication Date Title
US20080082684A1 (en) computer implemented method and apparatus for content conversion, routing and execution
US20130132833A1 (en) Systems and Methods For Remote Tracking And Replay Of User Interaction With A Webpage
US12355845B2 (en) Methods and apparatus for census and panel matching using HTTP headers
CN109981711A (en) Document dynamic playback method, device, system and computer-readable storage medium
CN108040045B (en) Access flow file generation method and device, server and storage medium
CN110753050B (en) Method and device for generating protocol document, computer storage medium and electronic equipment
WO2020248649A1 (en) Audio and video data synchronous playback method, apparatus and system, electronic device and medium
JP2023522092A (en) INTERACTION RECORD GENERATING METHOD, APPARATUS, DEVICE AND MEDIUM
CN115866331B (en) Video frame extraction analysis method, device, equipment and storage medium
JP2022536387A (en) Video data processing method, apparatus, electronic equipment and computer readable medium
CN112491421B (en) Log file compression package parsing method, device, equipment and medium
CN114630143B (en) Video stream storage method, device, electronic equipment and storage medium
US8230002B2 (en) Method and system for automatic setup in web-based applications
CN111930385A (en) Data acquisition method, device, equipment and storage medium
CN116095351B (en) Information processing method, information processing device, electronic device and storage medium
CN101217557B (en) Web server and its web service method
CN113453076B (en) User video service quality evaluation method, device, computing device and storage medium
CN114925222B (en) A method for constructing a multi-platform video sample library
CN112019531A (en) File compression method and system based on HTTP (hyper text transport protocol) and electronic equipment
CN111447490A (en) Streaming media file processing method and device
US9483575B2 (en) Reproducing a graphical user interface display
CN113542412B (en) Data transmission method, device, electronic equipment and storage medium
CN112866745B (en) Streaming media video data processing method, device, computer equipment and storage medium
CN114979719B (en) Video playing method, device, medium and electronic equipment
CN108833906B (en) A cable television signal transmission method, system, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant