WO2004013752A1 - Method and apparatus for accessing multiple vector elements in parallel - Google Patents
Method and apparatus for accessing multiple vector elements in parallel Download PDFInfo
- Publication number
- WO2004013752A1 WO2004013752A1 PCT/IB2003/003150 IB0303150W WO2004013752A1 WO 2004013752 A1 WO2004013752 A1 WO 2004013752A1 IB 0303150 W IB0303150 W IB 0303150W WO 2004013752 A1 WO2004013752 A1 WO 2004013752A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- memory
- vector
- address
- elements
- port
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/30003—Arrangements for executing specific machine instructions
- G06F9/3004—Arrangements for executing specific machine instructions to perform operations on memory
- G06F9/30043—LOAD or STORE instructions; Clear instruction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/34—Addressing or accessing the instruction operand or the result ; Formation of operand address; Addressing modes
- G06F9/345—Addressing or accessing the instruction operand or the result ; Formation of operand address; Addressing modes of multiple operands or results
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
- G06F9/3885—Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
Definitions
- the present invention relates to a computer system comprising: a processor; a multi-port memory, the multi-port memory being accessible by the processor.
- the present invention further relates to a method for transmitting a vector, in said computer system.
- the present invention relates to a computer program for implementing said method.
- Vector processing is a suitable technique for processing applications that have large computational demands.
- Vector processors provide high-level operations that work on vectors, i.e. linear arrays of numbers.
- Vector processors pipeline the operations on the individual elements of a vector.
- the pipeline includes not only the arithmetic operations, but also memory accesses and effective address calculations, i addition, most high-end vector processors allow multiple operations to be done at the same time, creating parallelism among the operations on different elements.
- Vector instructions have several important properties. First, the computations of each result are independent of the computations of previous results, allowing a very deep pipeline without generating any data hazards. Second, a vector instruction is equivalent to executing an entire loop, reducing the instruction bandwidth requirement.
- a vector memory system has a large datawidth, which allows retrieving a complete vector of data elements in one memory access using a single memory address. Subsequently, these data elements can be processed in parallel.
- several problems can occur when retrieving data from a vector memory system.
- the problem of vector alignment is related to reading from a vector memory system data that cross vector boundaries, hi that case the data can be retrieved by requesting the contents of two memory addresses, i.e. two vectors, and subsequently transfer the requested data to a new vector.
- the extracted vector is replicated into a third register such that the third register contains a plurality of elements aligned for vector processing.
- a first vector is loaded from a memory unit into a first register and a second vector is loaded from the memory unit into a second register.
- a subset of elements is selected from the first register and the second register.
- the elements from the subset are then replicated into the elements in the third register in a particular order suitable for subsequent vector processing.
- An object of the invention is to provide an improved method for vector alignment and ordering of vector elements, resulting in a better performance of vector processors.
- This object is achieved with a method for transmitting a vector, characterized in that the method comprises the steps of: passing a base memory address to an address configuration means; defining a set of memory addresses by the address configuration means using the base memory address and a configuration instruction for configuring the address configuration means; transmitting the vector to/from the multi-port memory using the set of memory addresses.
- the method allows transmitting a complete vector to or from a multi-port memory, using a single base memory address.
- the data elements of a vector can be transmitted to or from arbitrary positions within the memory, improving flexibility and avoiding problems related to vector alignment and ordering of vector elements.
- the use of a multi-port memory in combination with said address configuration means reduces the instruction width.
- a complete vector can be transmitted using a single base memory address, whereas otherwise each memory address used by the multi-port memory should be present in the instruction. For certain types of processors, such as very large instruction word processors, reducing the code size is an important issue.
- a computer system is characterized in that the computer system further comprises an address configuration means, wherein the address configuration means is conceived to define a set of memory addresses using a base memory address and a configuration instruction for configuring the address configuration means, and wherein the multi-port memory is conceived to use the set of memory addresses.
- the address configuration means is conceived to define a set of memory addresses using a base memory address and a configuration instruction for configuring the address configuration means
- the multi-port memory is conceived to use the set of memory addresses.
- Complete vectors can be transmitted to or from the multi-port memory using one base memory address, which reduces memory overhead and increases the performance of the computer system.
- the address configuration means comprises: a plurality of register files arranged to be configured by the configuration instruction, and a plurality of address calculation units for calculating the set of memory addresses; the register files are accessible by the address calculation units; the address calculation units are coupled to the multi-port memory.
- the configuration instruction configures the plurality of register files, and these register files can hold this configuration until the next configuration instruction is executed. In between, this configuration can be used repeatedly, for example during execution of a loop of instructions.
- An embodiment of the computer system according to the invention is characterized in that the configuration instruction comprises a set of offsets, each offset in combination with the base memory address defining a second memory address.
- the set of offsets can be directly loaded in the plurality of register files and used by the plurality of address calculation units, improving the performance of the address configuration means.
- Fig. 1 shows a schematic diagram of a computer system according to the invention.
- Fig. 2 shows a schematic diagram of a memory system having a multi-port memory and an address configuration means.
- Fig. 1 shows a block diagram of a computer system comprising a processor PROC, an address configuration unit ACU, a multi-port memory MEM and a system bus SB.
- the processor PROC, the address configuration unit ACU and the multi-port memory MEM are coupled via the system bus SB.
- the processor PROC may issue operations to access the multi-port memory MEM in order to read or write a vector with data elements.
- the address configuration unit ACU Prior to reading or writing a set of data elements from the multi-port memory MEM, the address configuration unit ACU should be configured by means of a configuration instruction, issued by the processor PROC.
- the configuration instruction configures the address configuration unit ACU so that it is capable of calculating a set of memory addresses specific for the set of data elements to be retrieved from the multi-port memory MEM, using a base memory address.
- the configuration of the address calculation unit ACU remains unchanged until a next configuration instruction is issued.
- the processor issues a read operation, comprising a base memory address, and the latter is sent to the address calculation unit ACU.
- the address calculation unit ACU calculates a set of memory addresses. These memory addresses are sent to the multi-port memory MEM via the system bus SB, followed by reading the data elements from the multi-port memory MEM. These data elements are sent as a single vector to the processor PROC and-used for further processing.
- a base memory address is sent to the address configuration unit ACU.
- the address configuration unit ACU calculates a set of memory addresses, which are sent to the multi-port memory MEM, via the system bus SB.
- the data elements are also sent to the multi-port memory MEM via the system bus SB.
- the data elements are written to the multi-port memory MEM.
- Fig. 2 shows a block diagram of a memory system MS, comprising a multi- port memory MEM and an embodiment of an address configuration unit ACU.
- the multi- port memory MEM comprises a RAM memory, four data input ports Datln, four address ports Addr and four data output ports DatOut.
- the address configuration unit ACU comprises an address port Addrln, four address calculation units AU, four register files RF and four data input ports Datln.
- the data inputs Datln are shared data input ports for both the address configuration unit ACU and the multi-port memory MEM.
- the address input port Addrln is coupled to the address calculation units AU, and the address calculation units AU are coupled to their corresponding address port Addr of the multi-port memory MEM.
- the data input ports Datln are coupled to the register files RF.
- the register files RF are accessible by the address calculation units AU.
- the multi-port memory MEM supports commands for reading and writing of data.
- data can be read from the RAM memory via the data output ports DatOut.
- the four data elements read from the data output ports DatOut can be combined into one vector.
- a set of four data elements can be written to the multi-port memory, via the data input ports Datln and using the address ports Addr for memory addressing.
- the address configuration units ACU support a configuration instruction, which specifies a set of offsets relative to a base memory address.
- a configuration instruction which specifies a set of offsets relative to a base memory address.
- an offset value is written to each of the register files RF, via the corresponding data input port Datln.
- the address calculation units AU fetch the offset value from their corresponding register file RF and store this value internally.
- the processor PROC issues a read operation to the memory system MS, abase memory address is provided at the address port Addrln.
- the address calculation units AU take the value of the base memory address from the address input port Addrln and add their corresponding offset value.
- the address calculation units AU send the resulting set of memory addresses to the corresponding address ports Addr, and subsequently a read command is issued to the multi-port memory MEM.
- the resulting set of data elements is provided at the data output ports DatOut of the multi-port memory MEM.
- the processor PROC may also issue a write operation to the memory system MS in order to write a set of data elements to the RAM memory.
- the address port Addrln receives a base memory address.
- the address calculation units AU calculate a set of memory addresses, using the base memory address and their corresponding offset value.
- the resulting set of memory addresses is sent to the corresponding address ports Addr of the multi-port memory MEM.
- the data elements are sent to the data input ports Datln of the multi-port memory MEM. Subsequently, a write command is issued to the multi-port memory MEM and the data elements are written to the RAM memory.
- the configuration instruction may comprise a set of commands issued to the address configuration units AU for calculating a set of offsets.
- the set of offsets received by the register files RF will be such that in combination with a base memory address the address calculation units AU are capable of defining an arbitrary set of memory addresses.
- a set of data elements can be simultaneously written to or retrieved from the multi-port memory MEM.
- the memory system MS therefore behaves as a vector memory system, having the advantage of allowing retrieving a set of data elements from arbitrary memory locations using one base memory address.
- the memory system MS has the advantage that using one memory address, a set of data elements can be addressed instead of requiring a set of memory addresses from an external source.
- the instruction width can be reduced, which is especially of interest for very large instruction word processors, where reduction of code size is an important issue.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Complex Calculations (AREA)
- Executing Machine-Instructions (AREA)
Abstract
Description
Claims
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/522,085 US20060155953A1 (en) | 2000-06-19 | 2003-07-10 | Method and apparatus for accessing multiple vector elements in parallel |
| AU2003281792A AU2003281792A1 (en) | 2002-07-26 | 2003-07-10 | Method and apparatus for accessing multiple vector elements in parallel |
| EP03741006A EP1527385A1 (en) | 2002-07-26 | 2003-07-10 | Method and apparatus for accessing multiple vector elements in parallel |
| JP2004525660A JP2005534120A (en) | 2002-07-26 | 2003-07-10 | Apparatus and method for accessing multiple vector elements in parallel |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP02078074.8 | 2002-07-26 | ||
| EP02078074 | 2002-07-26 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2004013752A1 true WO2004013752A1 (en) | 2004-02-12 |
Family
ID=31197898
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IB2003/003150 Ceased WO2004013752A1 (en) | 2000-06-19 | 2003-07-10 | Method and apparatus for accessing multiple vector elements in parallel |
Country Status (5)
| Country | Link |
|---|---|
| EP (1) | EP1527385A1 (en) |
| JP (1) | JP2005534120A (en) |
| CN (1) | CN1672128A (en) |
| AU (1) | AU2003281792A1 (en) |
| WO (1) | WO2004013752A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100349122C (en) * | 2005-08-19 | 2007-11-14 | 华为技术有限公司 | Method for realizing data packet sequencing for multi engine paralled processor |
| CN100417142C (en) * | 2005-12-22 | 2008-09-03 | 华为技术有限公司 | Method for sharing interface traffic among multiple network processor engines |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2641374C (en) | 2006-02-15 | 2014-08-12 | Thomson Licensing | Non-linear, digital dailies |
| US9021233B2 (en) * | 2011-09-28 | 2015-04-28 | Arm Limited | Interleaving data accesses issued in response to vector access instructions |
| CN102930008B (en) * | 2012-10-29 | 2015-10-07 | 无锡江南计算技术研究所 | Vector look-up method |
| US9606803B2 (en) | 2013-07-15 | 2017-03-28 | Texas Instruments Incorporated | Highly integrated scalable, flexible DSP megamodule architecture |
| CN107729990B (en) * | 2017-07-20 | 2021-06-08 | 上海寒武纪信息科技有限公司 | Apparatus and method for performing forward operations supporting discrete data representation |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5155823A (en) * | 1988-04-18 | 1992-10-13 | Matsushita Electric Industrial Co., Ltd. | Address generating unit |
| US5590353A (en) * | 1993-07-15 | 1996-12-31 | Hitachi, Ltd. | Vector processor adopting a memory skewing scheme for preventing degradation of access performance |
| WO2001098893A1 (en) * | 2000-06-19 | 2001-12-27 | Koninklijke Philips Electronics Nv | Generation of memory addresses utilizing scheme registers |
-
2003
- 2003-07-10 WO PCT/IB2003/003150 patent/WO2004013752A1/en not_active Ceased
- 2003-07-10 EP EP03741006A patent/EP1527385A1/en not_active Withdrawn
- 2003-07-10 AU AU2003281792A patent/AU2003281792A1/en not_active Abandoned
- 2003-07-10 JP JP2004525660A patent/JP2005534120A/en active Pending
- 2003-07-10 CN CN 03817860 patent/CN1672128A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5155823A (en) * | 1988-04-18 | 1992-10-13 | Matsushita Electric Industrial Co., Ltd. | Address generating unit |
| US5590353A (en) * | 1993-07-15 | 1996-12-31 | Hitachi, Ltd. | Vector processor adopting a memory skewing scheme for preventing degradation of access performance |
| WO2001098893A1 (en) * | 2000-06-19 | 2001-12-27 | Koninklijke Philips Electronics Nv | Generation of memory addresses utilizing scheme registers |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100349122C (en) * | 2005-08-19 | 2007-11-14 | 华为技术有限公司 | Method for realizing data packet sequencing for multi engine paralled processor |
| CN100417142C (en) * | 2005-12-22 | 2008-09-03 | 华为技术有限公司 | Method for sharing interface traffic among multiple network processor engines |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1527385A1 (en) | 2005-05-04 |
| CN1672128A (en) | 2005-09-21 |
| JP2005534120A (en) | 2005-11-10 |
| AU2003281792A1 (en) | 2004-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20060155953A1 (en) | Method and apparatus for accessing multiple vector elements in parallel | |
| US11183225B2 (en) | Memories and methods for performing vector atomic memory operations with mask control and variable data length and data unit size | |
| US9400652B1 (en) | Methods and apparatus for address translation functions | |
| JP2002518730A (en) | Register and method for accessing register used in single instruction multiple data system | |
| US8046568B2 (en) | Microprocessor with integrated high speed memory | |
| JP2001273277A (en) | System and method for arithmetic processing and program storage device therefor | |
| EP3671424A1 (en) | Method and apparatus for accessing tensor data | |
| US6061772A (en) | Split write data processing mechanism for memory controllers utilizing inactive periods during write data processing for other transactions | |
| US5307300A (en) | High speed processing unit | |
| US5687353A (en) | Merging data using a merge code from a look-up table and performing ECC generation on the merged data | |
| JP2818529B2 (en) | Information storage device | |
| EP1527385A1 (en) | Method and apparatus for accessing multiple vector elements in parallel | |
| US5752271A (en) | Method and apparatus for using double precision addressable registers for single precision data | |
| US7774583B1 (en) | Processing bypass register file system and method | |
| US6401151B1 (en) | Method for configuring bus architecture through software control | |
| US20250173146A1 (en) | Technique for handling data elements stored in an array storage | |
| US12504973B2 (en) | Technique for handling data elements stored in an array storage | |
| EP1384145B1 (en) | Expanded functionality of processor operations within a fixed width instruction encoding | |
| US9583158B2 (en) | Method of managing requests for access to memories and data storage system | |
| EP4475003A1 (en) | Processing-in-memory memory device and method for performing indirect addressing in the same | |
| US4805133A (en) | Processor memory element and a new computer architecture | |
| JP2576589B2 (en) | Virtual storage access control method | |
| WO2025210334A1 (en) | Vector cryptographic processing | |
| KR20230095775A (en) | Memory expander performing near data processing function and accelerator system including the same | |
| JP2003196087A (en) | Memory addressing system of microcontroller and page mapping device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 2003741006 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004525660 Country of ref document: JP |
|
| ENP | Entry into the national phase |
Ref document number: 2006155953 Country of ref document: US Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 10522085 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 20038178605 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 2003741006 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 10522085 Country of ref document: US |