Please read the article on data formats and output formats first, to make sure that you want to use this particular data format.
Database diagram
Dependency diagram for the CSV output format, including SQL scripts for generating the tables and to load the data with load data local infile at the end of this article.
Overview of data format elements
In CSV output format, these elements are files, in XML or JSON output format these are nodes.
The data format developer consists of the following elements:
- product: product from the ITscope catalogue.
- manufacturer: manufacturer of a product.
- productType: type of product, e.g. server or processor.
- productTypeGroup: product type grouping.
- productPriceInfo: calculated price information for a product. This element is only present if a price can be selected and calculated from the pricing rules deposited on the platform by the supplier.
- productStockInfo: availability information for the selected source of supply in productPriceInfo.
- supplierItem: source of supply for an ITscope product. A specific product offering from a distributor listed on ITscope.
- supplier: supplier for a source of supply.
- supplierPriceInfo: price data for a source of supply. For each configured price source, a PriceInfo is stored, e.g. real-time, individual price list or generally available price list. For some suppliers, no generally available prices are listed. In this case, the supplierPriceInfo element is empty (if no individual price list has been configured).
- supplierStockInfo: availability information for the source of supply.
- project: price, availability and further information on a project item.
- attribute: properties of a product.
- attributeType: specific property types of the product specifications.
- attributeUnit: units of all specific property types.
- attributeCluster: property clusters in which the product can be found for feature searches. Can summarise several property expressions in intervals, according to the quantity, e.g. 64-128 MB RAM.
- keyContent: content data for a product that is provided in the form of keys (e.g. category IDs or tariff numbers)
- contentModel: classification of content in different types by the content provider.
- contentProvider: origin of the content, e.g. 1WorldSync, Icecat, manufacturer or distributor
- mediaContent: images, datasheet links and other media such as videos of a product.
- contentCategory: ITscope content categorisation (e.g. structured feature texts, product photo etc.).
- contentTag: tags for content, these markings are uniform irrespective of the content providers.
- refContent: various product references for a product, e.g. original accessories, compatible accessories, similar products or follow-up products.
- textContent: texts for the product, such as marketing texts, short texts, long texts or HTML descriptions.
Elements marked with a globe vary depending on the selected export language::
product
Product from the ITscope catalogue.
Name | Compulsory field | Data type | Description |
---|---|---|---|
puid | Yes | long | Unique key |
ean | String (18) | EAN | |
manufacturerSKU | String (40) | Manufacturer article number | |
icecatId | String (255) | IceCat ID | |
cnetId | String (255) | 1WorldSync ID (formerly CNET) | |
bechlemId | String (255) | Bechlem ID | |
eClass | String (255) | eClass ID Version 5.1.2 | |
manufacturer | Yes | manufacturer | Reference to the manufacturer of this product (n:1 on Manufacturer.id) |
productNameWithManufacturer | Yes | String | Product name, including manufacturer name |
shortDescription | String | Short description for the product | |
longDescription | String | Long description for the product | |
productType | Yes | productType | Reference to the product type of this product |
attributeValue1 | String (1024) | Attribute cluster value for the attribute from ProductType.attributeTypeId1. Can be used as a 3rd category level, if applicable | |
attributeValue2 | String (1024) | Attribute cluster value for the attribute from ProductType.attributeTypeId2. Can be used as a 4th category level, if applicable | |
attributeValue3 | String (1024) | Attribute cluster value for the attribute from ProductType.attributeTypeId3. Can be used as a 5th category level, if applicable | |
attributeValue4 | String (1024) | Attribute cluster value for the attribute from ProductType.attributeTypeId4 | |
attributeValue5 | String (1024) | Attribute cluster value for the attribute from ProductType.attributeTypeId5 | |
productSubTypeId | String (1024) | ID of product sub type | |
productSubType | String (1024) | Design property of the product, e.g. mouse or keyboard for input devices. Should not be used as a 3rd category level | |
productLineId | long | ID of the product line | |
productLine | String (1024) | Product line | |
productModel | String (1024) | Product model identifier | |
estimateGrossWeight | Double | Weight in kilograms | |
largeDimX | String (1024) | Length of the product including unit of measurement | |
largeDimY | String (1024) | Height of the product including unit of measurement | |
largeDimZ | String (1024) | Width of product including unit of measurement | |
customsTariffNumber | String (255) | Customs tariff number | |
deeplink | Yes | String (2048) | Deep link to the ITscope.com platform |
standardHtmlDatasheet | Yes | String (2048) | URL, link to HTML standard datasheet |
standardPdfDatasheet | String (2048) | URL, link to PDF standard datasheet | |
manufacturerSite | String (1024) | URL, link to manufacturer page | |
manufacturerDatasheet | String (1024) | URL, link to manufacturer datasheet | |
imageThumb | String (1024) | Preview of the best product image | |
imageThumbWidth | Integer | Width of the preview image in pixels | |
imageThumbHeight | Integer | Height of the preview image in pixels | |
image1 | String (1024) | Link to the best possible product image, in the largest version | |
imageWidth1 | Integer | Width of the image in pixels | |
imageHeight1 | Integer | Height of the image in pixels | |
image2 | String (1024) | Link to another good product image, preferably including product packaging (never the same as the first image) | |
imageWidth2 | Integer | Width of the image in pixels | |
imageHeight2 | Integer | Height of the image in pixels | |
image3 | String (1024) | Link to the first image in the gallery (not one of the already listed images above) | |
imageWidth3 | Integer | Width of the image in pixels | |
imageHeight3 | Integer | Height of the image in pixels | |
image4 | String (1024) | Link to the second picture in the gallery (not one of the already listed images above) | |
imageWidth4 | Integer | Width of the image in pixels | |
imageHeight4 | Integer | Height of the image in pixels | |
image5 | String (1024) | Link to the third image in the gallery (never one of the already listed) | |
imageWidth5 | Integer | Width of the image in pixels | |
imageHeight5 | Integer | Height of the image in pixels | |
energyLabel | String (1024) | Link to the Energy Label image | |
entryDate | Yes | Date | Since when has the product been listed on the platform? |
rank | Integer | Overall popularity rank (rank 1 to n, a high number corresponds to a bad ranking) | |
qualification | Integer | Qualification of the product | |
warrantyText | String | Warranty text for the product | |
marketingText | String | Marketing text for the product | |
htmlSpecs | String | Technical properties of the product, in HTML format | |
recommendedRetailPriceNet | Double | Manufacturer’s RRP | |
productPriceInfo | productPriceInfo | Calculated price information for a product. This element is only present if a price can be selected and calculated from the pricing rules deposited on the platform by the supplier | |
productStockInfo | productStockInfo | Availability information for the selected source of supply in productPriceInfo | |
aggregatedStatus | Yes | Integer | Best availability status |
aggregatedStatusText | Yes | String (20) | Best availability status |
aggregatedStock | Yes | Integer | Sum of all stock levels |
aggregatedSupplierItems | Yes | Integer | Sum of all distributors offering this product |
supplierItem | Yes | List <supplierItem> | Source of supply of an ITscope product. A specific offer from a distributor listed on ITscope |
attribute | List <attribute> | Properties of a product | |
attributeCluster | List <attributeCluster> | Property clusters in which the product can be found for feature searches. Can summarise several property expressions in intervals, according to the quantity, e.g. 64-128 MB RAM | |
keyContent | List <keyContent> | Content data for a product that is in the form of keys (eg category IDs, customs tariff numbers) | |
mediaContent | List <mediaContent> | Images, datasheet links and other media such as videos of a product | |
refContent | List <refContent> | Various product references for a product, e.g. original accessories, compatible accessories, similar products or follow-up products | |
textContent | List <textContent> | Texts for the product, such as marketing texts, short texts, long texts or HTML descriptions |
manufacturer
Manufacturer of a product.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Yes | long | Unique key |
name | Yes | String (255) | Manufacturer’s identifier |
shortName | Yes | String (255) | Manufacturer’s short name |
deeplink | Yes | String (2048) | URL, link to the manufacturer’s page on the ITscope platform |
productType
Type of product, e.g. server or processor.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Yes | long | Unique key |
productTypeGroup | Yes | ProductTypeGroup (3) | Reference to the product type group (ProductTypeGroup.id, n:1) |
name | Yes | String (255) | Identifier of the product type. Can be used as a 2nd category level |
attributeTypeId1 | long | Unambiguous attribute key for building a possible subcategory, points 1:n to AttributeCluster.attributeTypeId | |
attributeTypeName1 | String (255) | Identifier of the attribute to build up a possible subcategory | |
attributeTypeId2 | long | Unambiguous attribute key for building a possible subcategory, points 1:n to AttributeCluster.attributeTypeId | |
attributeTypeName2 | String (255) | Identifier of the attribute to build up a possible subcategory | |
attributeTypeId3 | long | Unambiguous attribute key for building a possible subcategory, points 1:n to AttributeCluster.attributeTypeId | |
attributeTypeName3 | String (255) | Identifier of the attribute to build up a possible subcategory | |
attributeTypeId4 | long | Unambiguous attribute key for building a possible subcategory, points 1:n to AttributeCluster.attributeTypeId | |
attributeTypeName4 | String (255) | Identifier of the attribute to build up a possible subcategory | |
attributeTypeId5 | long | Unambiguous attribute key for building a possible subcategory, points 1:n to AttributeCluster.attributeTypeId | |
attributeTypeName5 | String (255) | Identifier of the attribute to build up a possible subcategory |
productTypeGroup
Product type grouping.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Yes | String (3) | Unique key |
name | Yes | String (255) | Name of the group of product types, e.g. network technology. Can be used as a 1st category level |
productPriceInfo
Calculated price information for a product. Is only present if from the supplier deposited within the platform pricing rules, a product may be selected and calculated.
Name | Compulsory field | Data type | Description |
---|---|---|---|
price | Yes | BigDecimal | Price basis for the calculated price |
priceCalc | Yes | BigDecimal | Calculated price, based on the individual rice calculation |
currencyCode | Yes | String (3) | Currency unit that applies to this price information |
priceCalcVat | Yes | BigDecimal | Sales tax rate that was used to determine the calculated price |
priceLastUpdate | Yes | Date | Time of last update of price information |
minScale | Yes | Integer | Scaled prices |
priceSourceId | Yes | Integer | Identifier for the source of the price information |
priceSourceName | String (255) | Readable text on the origin of the price information, e.g. ‘Individual price list’ | |
priceStatus | Yes | String (255) | Textual information on price retrieval, e.g. ‘The retrieval of the data was successful’ |
priceSupplierId | Yes | long | Reference to the supplier (1:1) that provided the source of supply with this price information |
priceSupplierName | Yes | String (255) | Name of the supplier that provided this source of supply |
priceSupplierItemId | Yes | long | Reference to a source of supply (n:1); if this field is zero, then the price information refers to a product (source of supply reference and product reference are mutually exclusive) |
priceSupplierSKU | Yes | String (40) | Product identifier of the supplier that provided this source of supply |
productStockInfo
Availability information for the source of supply selected in productPriceInfo.
Name | Compulsory field | Data type | Description |
---|---|---|---|
stockSupplierText | String (40) | Textual stock information from the supplier, this is directly taken over without interpretation | |
stockStatus | Yes | Integer | Numeric key of the delivery status of the stock information |
stockStatusText | Yes | String (255) | Delivery status for this stock information, such as ‘in stock’ or ‘in field warehouse’ |
stock | Yes | Integer | Quantity available for the delivery status indicated in this structure |
externalStock | Integer | External stock (additional information provided by some suppliers in structures with ‘in stock’ delivery status) | |
incomingStock | Integer | Stock quantity that will be replenished (additional information provided by some suppliers in structures with ‘in stock’ delivery status) | |
stockAvailabilityDate | Date | Delivery date for products that are not in stock | |
stockLastUpdate | Yes | Date | Time of last update of stock information |
stockSourceId | Yes | Integer | Numeric key for the source of stock information |
stockSourceName | Yes | String (255) | Source of stock information, e.g. ‘Individual price list’ |
stockUnlimited | Yes | Boolean | Indicates whether the items of this stock information are available in an unlimited quantity |
supplierItem
Source of supply of an ITscope product. A specific product offering from a distributor listed on ITscope.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Yes | Long | Unique key |
ean | String (18) | EAN provided by the supplier | |
manufacturerSKU | String (40) | Manufacturer article number (does not have to match ITscope) | |
supplierSKU | String (40) | Product number of the supplier | |
supplier | Yes | supplier | Refers 1:1 to Supplier.id |
manufacturerName | String (80) | Manufacturer name as specified by supplier | |
productName | String (255) | Exact identifier of the product, as given by the supplier | |
longDescription | String (60000) | Extended supplier description | |
conditionId | Yes | Integer | Numeric code for the item condition |
conditionName | Yes | String (255) | Item condition (new, used, B-Stock, Refurbished, etc.) |
eolProduct | Yes | Boolean | Product end of life notification |
matchQuality | Yes | Integer | Matching quality of the product for ITscope product catalogue |
eanValid | Yes | Boolean | Flag to indicate whether the EAN of the supplier is valid according to the EAN criteria |
specialOffer | Yes | Boolean | Flag to indicate whether the item is on special offer |
promotion | String (40) | Name of the promotion activity of the supplier | |
vat | Integer | VAT rate for the item | |
copyrightLevy | Double | Copyright levy | |
customsTariffNumber | String (50) | Customs tariff number | |
countryOfOrigin | String (20) | Country of origin of the item | |
grossDimX | Double | Length of the product including unit of measurement | |
grossDimY | Double | Height of the product including unit of measurement | |
grossDimZ | Double | Width of product including unit of measurement | |
warrantyText | String (40) | Supplier’s warranty | |
deeplink | String (1024) | Link to the product at the supplier | |
recommendedRetailPriceNet | Double | RRP given by the supplier | |
supplierPriceInfo | List <supplierPriceInfo> | Price data for a source of supply. For each configured price source, a PriceInfo is stored, e.g. Realtime, individual price list or generally available price list. For some vendors, no generally available prices are listed. In this case, the supplierPriceInfo is empty (if no own price list has been configured) | |
supplierStockInfo | List <supplierStockInfo> | Availability information for the source of supply |
supplier
Supplier of a source of supply.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Yes | long | Unique key |
name | Yes | String (255) | Identifier of the supplier |
deeplink | Yes | String (2048) | URL, link to the supplier page on the ITscope platform |
customerAccountNumber | String (255) | Customer number in case of partnership. Can be used as a filter to determine if there is a partnership with this supplier |
supplierPriceInfo
Price data for a source of supply. For each configured price source, a PriceInfo is stored, e.g. real-time, individual price list or generally available price list. For some suppliers, no generally available prices are listed. In this case, the supplierPriceInfo is empty (if no individual price list has been configured).
Name | Compulsory field | Data type | Description |
---|---|---|---|
price | Yes | BigDecimal | Price basis for the calculated price |
priceCalc | Yes | BigDecimal | Calculated price, based on the individual price calculation |
currencyCode | Yes | String (3) | Currency unit that applies to this price information |
priceCalcVat | Yes | BigDecimal | Sales tax rate that was used to determine the calculated price |
priceLastUpdate | Yes | Date | Time of last update of price information |
minScale | Yes | Integer | Scaled price |
priceSourceId | Yes | Integer | Identifier for the source of the price information |
priceSourceName | String (255) | Readable text on the origin of the price information, e.g. ‘Individual price list’ | |
priceStatus | Yes | String (255) | Textual information on price retrieval, e.g. ‘The retrieval of the data was successful’ |
supplierStockInfo
Availability information for the source of supply.
Name | Compulsory field | Data type | Description |
---|---|---|---|
stockSupplierText | String (40) | Textual stock information from the supplier, this is directly taken over without interpretation | |
stockStatus | Yes | Integer | Numeric key of the delivery status of the stock information |
stockStatusText | Yes | String (255) | Delivery status for this stock information, such as ‘in stock’ or ‘in field warehouse’ |
stock | Yes | Integer | Quantity available for the delivery status indicated in this structure |
externalStock | Integer | External stock (additional information provided by some suppliers in structures with ‘in stock’ delivery status) | |
incomingStock | Integer | Stock quantity that will be replenished (additional information provided by some suppliers in structures with ‘in stock’ delivery status) | |
stockAvailabilityDate | Date | Delivery date for products that are not in stock | |
stockLastUpdate | Yes | Date | Time of last update of inventory information |
stockSourceId | Yes | Integer | Numeric key of the source of stock information |
stockSourceName | Yes | String (255) | Source of stock information, e.g. ‘Individual price list’ |
stockUnlimited | Yes | Boolean | Indicates whether the items of this stock information are available in an unlimited quantity |
project
Price, availability and further information on a project agreement.
Name | Compulsory field | Data type | Description |
---|---|---|---|
supplierProjectId | String (40) | Project number of the supplier | |
manufacturerProjectId | Yes | String (40) | Project number of the manufacturer (unique key) |
projectName | String (255) | Project description | |
endCustomer | String (255) | End customer for the project item | |
price | Yes | BigDecimal | Project price |
validFrom | Date | Date the project conditions become valid | |
validTo | Date | Date the project conditions expire | |
targetQuantity | Integer | Negotiated project amount | |
remainingQuantity | Yes | Integer | Remaining quota that can be ordered |
minQuantity | Integer | Minimum ordering quantity | |
projectLastUpdate | Date | Time of last update of project information |
attribute
Properties of a product.
Name | Compulsory field | Data type | Description |
---|---|---|---|
value | String (10000) | The base value (see also the base unit) of the property, for text as a text block and for numbers as the smallest indication | |
displayValue | String (10000) | The readable value of the property, including unit | |
qualification | Long | Qualification of the property | |
attributeType | attributeType | Unique identifier of a specific property type |
attributeType
Specific property types of product specifications.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | Long | Unique identifier of a specific property type | |
name | String (255) | Name of the specific property type | |
rank | Long | Ranking of the property type. For example, this can be used for sorting | |
type | Integer | Data type of the property type | |
attributeUnit | attributeUnit | Reference to the attributeUnits table | |
groupId | Long | Identifier of a property group, not a table reference, but uniquely identifies attributeTypeGroupName | |
groupName | String (255) | Name of the property group |
attributeUnit
Units of all concrete property types.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | String (100) | Unique identifier of a unit | |
baseUnitId | String (100) | The base unit of the unit | |
mFactor | long | Multiplication factor for the conversion of the base unit to unit | |
divFactor | long | Divisor for the conversion of the base unit to unit |
attributeCluster
Property clusters in which the product can be found for feature searches. Can summarise several property expressions in intervals, according to the quantity, e.g. 64-128 MB RAM.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | long | Unique ITscope key | |
productTypeId | long | Reference to the product type, optional | |
name | String (255) | Identifier of the design (eg 2 GB, 15 “, 80 W – 120 W) | |
min | String (255) | Minimal limit with respect to a property in which the value of the product must fall, in order to be assigned to this attribute cluster | |
max | String (255) | Maximum limit with respect to a property in which the value of the product must fall, in order to be assigned to this attribute cluster | |
rank | long | Rank of the property | |
attributeTypeId | long | Identifies a property and identifies attributeTypeName, attributeTypeRank, and attributeTypeUnit. No table reference. Refer to: ProductType.attributeTypeId (1..5) | |
attributeTypeName | String (255) | Name of a property. Can be the same as the name from ProductType.attributeTypeName (1..5) | |
attributeTypeRank | long | Ranking of the property. For example, this can be used for sorting | |
attributeTypeUnit | String (100) | Unit of the property | |
attributeTypeGroupId | String (20) | Identifier of a property group, no table reference, but uniquely identifies attributeTypeGroupName | |
attributeTypeGroupName | String (255) | Name of a property group |
keyContent
Content data for a product that is in the form of keys (eg category IDs, customs tariff numbers)
Name | Compulsory field | Data type | Description |
---|---|---|---|
key | Long | Key of the record, not unique | |
langId | Long | Internal identifier of the language of this content | |
contentModel | contentModel | Reference to the type of content (ContentModel.id, n:1) | |
contentProvider | contentProvider | Reference to the content provider (ContentProvider.id, n:1) | |
contentCategory | contentCategory | Reference to the content category (ContentCategory.id, n:1) | |
value | String (255) | Content of the content (value of the key) | |
lang | String (10) | Language code in ISO639 for the language of the content |
contentModel
Classification of content in different types by the content provider.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | long | Unique key | |
name | String (1023) | Displayed name of the content (e.g. Icecat standard image large, 1WorldSync product ID) |
contentProvider
Origin of the content e.g. 1WorldSync, Icecat, manufacturer or distributor
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | long | Unique key | |
name | String (255) | Clear text name of the content supplier (e.g. Icecat, 1WorldSync) | |
rank | Integer | Prioritisation for sorting, same values are possible several times |
mediaContent
Images, datasheet links, and other media, such as videos, for a product.
Name | Compulsory field | Data type | Description |
---|---|---|---|
key | Long | Key of the data set, not unique | |
langId | Long | Language identifier for the ‘lang’ field, but does not reference a table | |
contentModel | contentModel | Reference to the type of content (ContentModel.id, n:1) | |
contentProvider | contentProvider | Reference to the content provider (ContentProvider.id, n:1) | |
contentCategory | contentCategory | Reference to the content category (ContentCategory.id, n:1) | |
contentTag | List (60) | Comma separated list of tags, refer to ContentTag.id | |
value | String (1024) | Content of the content (value of the medium) | |
lang | String (10) | Language code in ISO639 | |
mimeType | String (255) | MIME Type of content (e.g. image/JPEG, text/HTML) | |
imageWidth | Integer | Width of the image in pixels | |
imageHeight | Integer | Height of the image in pixels |
contentCategory
ITscope categorisation of content (e.g. structured feature descriptions, product photo, etc.).
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | long | Unique key | |
name | String (255) | Identifier of category |
contentTag
Tags for content, uniform markings on content providers across.
Name | Compulsory field | Data type | Description |
---|---|---|---|
id | long | Unique key | |
name | String (40) | Identifier for the content type (small picture, thumbnail, marketing text) | |
rank | Integer | Prioritisation for sorting, same values are possible several times | |
source | String (10) | ‘itscope’ if ITscope’s tag was entered, ‘supplier’ for tags automatically generated from read-in data |
refContent
Various product references for a product, e.g. original accessories, compatible accessories, similar products, successor products
Name | Compulsory field | Data type | Description |
---|---|---|---|
key | long | Key of the record, not unique | |
contentModel | contentModel | Reference to the type of content (ContentModel.id, n:1) | |
contentProvider | contentProvider | Reference to the content provider (ContentProvider.id, n:1) | |
crossProductRefId | long | Reference to a reference product, e.g. a product which is listed as original accessory | |
typeId | Integer | Internal identifier for the type of the reference product | |
type | String (255) | Identifier for the type of the reference product, including original accessories, all compatible accessories etc. |
textContent
Texts regarding the product, such as marketing texts, short texts, long texts or HTML descriptions.
Name | Compulsory field | Data type | Description |
---|---|---|---|
key | long | Key of the record, not unique | |
langId | long | Language identifier for the ‘lang’ field, but does not reference a table | |
contentModel | contentModel | Reference to the type of content (ContentModel.id, n:1) | |
contentProvider | contentProvider | Reference to the content provider (ContentProvider.id, n:1) | |
contentCategory | contentCategory | Reference to the content category (ContentCategory.id, n:1) | |
contentTag | List (60) | Comma-separated list of tags, refers to ContentTag.id | |
value | String | Content of the content (product texts) | |
lang | String (10) | Language code in ISO639 | |
mimeType | String (255) | MIME Type of content (e.g. plain/text, text/HTML) |