[Lds] ideas/recommendations for JSON-LD serializations
pohl at hbz-nrw.de
Di Apr 24 16:48:43 CEST 2018
On 4/23/18 3:55 PM, Thomas Gängler wrote:
> Hi Adrian,
> thanks a lot for your proper "pitch" for lobid ;)
> of course, we are a aware of the lobid services and it's also always a
> huge inspiration for us. However, right now for our use case we are
> looking for complete dumps of GND etc. - so yes, it's cool that lobid
> offers some of the proposed features, but since you do not offer dumps
> of your data, it's not applicable for or use case (where performance
Actually, you can use the lobid API to download dumps as gzip with the
gzip content header and using the format=bulk parameter, e.g. for ZDB data:
$ curl --header "Accept-Encoding: gzip"
See also the API documentation at .
And you can also fetch updates for a date range, e.g. by adding " AND
20180405]+OR+describedBy.dateCreated:[20180403 TO 20180405]" to the
Same goes for lobid-organisations but for lobid-gnd we still have to add
modification dates and bulk request support (see  & ).
All the best
> *) I know, this somehow destroys the vision of distributed data
> available via the web, but at the end performance matters (and then you
> often need the data locally available (e.g. via a search index))
> On 04/23/2018 01:19 PM, Adrian Pohl wrote:
>> Hello Thomas,
>> I am responding as we also provide ZDB and GND data as well as data
>> from the German ISIL registry via lobid and already offer most of the
>> things you are asking for. So, you may want to give it a try.
>> Generally, lobid-gnd is available via https://lobid.org/gnd and is
>> still in beta, amongst others because we haven't implemented yet
>> adding labels for embedded nodes (see  and its prerequisite ).
>> ZDB data is available as part of lobid-resources at
>> https://lobid.org/resources. You have to filter by collection to get
>> all ZDB resources.  Note that the RDF representation of ZDB
>> resources, though very similar, differs from that by the ZDB itself,
>> see an annotated example at .
>> And if you are also interested in ISIL data (Adressverzeichniss der
>> ZDB), then go to lobid-organisations: https://lobid.org/organisations.
>> On 19.04.2018 14:14, Thomas Gängler wrote:
>>> currently, we process some JSON-LD dumps (e.g. ZDB and GND) from data
>>> available via DNB. Our observations while processing them are following:
>>> 1. It would be nice, if you could provide line-delimited JSON 
>>> records (instead of one large JSON object/array (as it is the case
>>> right now))
>> We already provide JSON Lines  for lobid-organisations and
>> lobid-resources, see . We will also add it for lobid-gnd.
>>> 2. It would be nice, if the JSON-LD records could be provided in
>>> compact JSON-LD  (instead of the extended format (as it is the
>>> case right now)) + referenced @context* (instead of inline @context)
>> All lobid services provide compacted JSON-LD with a referenced @context.
>>> 3. It would be nice, if the (compact) JSON-LD records contain all
>>> sub-entities (i.e. there are no separate bnodes, but (if necessary)
>>> hierarchical entities), cf. ,  or similar (instead of separate
>>> bnode objects in the same hierarchy level (as it is the case right now))
>> lobid provides JSON-LD documents with one root node and with all other
>> nodes embedded in the hierarchy. (This was a main reason and major
>> improvement in our move from lobid 1.x to the new version.) We don't
>> add the whole data on an embedded node but only provide a label for
>> display purposes. (As said above, we are still working on implementing
>> this in lobid-gnd.) Further data must be fetched from the linked
>>> We believe that all recommended changes will lead to a better
>>> usability of the provided JSON-LD data. Hence, we and probably other
>>> data consumers of the DNB datasets will be happy, if you could
>>> implement our proposed ideas.
>> I agree.
>> All the best
>>  https://github.com/hbz/lobid-gnd/issues/24
>>  https://github.com/hbz/lobid-gnd/issues/85
>>  http://lobid.org/resources/api#periodikum
>>  http://jsonlines.org/
>>  http://lobid.org/resources/api#content_types
>>> Best regards,
>>> *) referenced context requires that you probably need to provide/host
>>> the context documents at DNB (instead of, e.g., ZDB Github account )
>>>  https://en.wikipedia.org/wiki/JSON_streaming#Line_delimited_JSON
>>>  https://www.w3.org/TR/json-ld-api/#compaction
>>>  https://github.com/Zeitschriftendatenbank/jsonld-context
>>>  https://www.w3.org/Submission/CBD/
>>>  Minimum Spanning Graph:
>>> lds mailing list
>>> lds at lists.dnb.de
hbz - Hochschulbibliothekszentrum des Landes NRW
Jülicher Straße 6
Mehr Informationen über die Mailingliste lds