Handling large geo data with Julia
type: RoCrateNanopub
created: 2026-03-03T15:24:03.685+01:00
creator: RoCrateBot
type: Nanopublication
has assertion: assertion
has provenance: provenance
has publication info: pubinfo

sig
has algorithm: RSA
signed by: RoCrateBot

Applied sciences
type: DefinedTerm

Earth sciences
type: DefinedTerm

Pangeo discourse post announcing 1st September Show & Tell by Felix Cremer.
type: Document
type: Resource
type: MediaObject
date created: 2022-09-02 19:15:52.939627+00:00
date modified: 2022-09-02 19:15:53.645033+00:00
description: You will find here all the information published to advertise the Pangeo Show & Tell Talk frm Felix Cremer on "Handling large geo data with Julia ".
license: no-permission
sd date published: 2022-09-02 19:15:52.939627+00:00

Pangeo Europe
type: Agent

ESDLtutorial Github repository.
type: Resource
type: MediaObject
type: SWDocumentation
date created: 2022-09-02 19:36:28.455672+00:00
date modified: 2022-09-05 13:48:03.496113+00:00
description: This will become a selection of tutorials on the use of ESDL.jl and YAXArrays.jl julia packages for the handling of large scale out-of-core geospatial datasets.
keywords: github
license: no-permission
sd date published: 2022-09-02 19:36:28.455672+00:00

ne_50m_admin_0_countries.dbf
type: Dataset
type: Resource
type: MediaObject
date created: 2022-09-02 19:27:25.914754+00:00
date modified: 2022-09-08 09:47:29.994336+00:00
description: Part of ne_50m_admin_0_countries shapefile.
license: no-permission
sd date published: 2022-09-02 19:27:25.914754+00:00

ne_50m_admin_0_countries.shp
type: Dataset
type: Resource
type: MediaObject
date created: 2022-09-02 19:28:35.477795+00:00
date modified: 2022-09-08 09:47:41.190627+00:00
description: Part of ne_50m_admin_0_countries shapefile.
encoding format: application/x-qgis
license: no-permission
sd date published: 2022-09-02 19:28:35.477795+00:00

ne_50m_admin_0_countries.shx
type: Dataset
type: Resource
type: MediaObject
date created: 2022-09-02 19:29:06.833916+00:00
date modified: 2022-09-08 09:47:51.906422+00:00
description: Part of ne_50m_admin_0_countries shapefile.
encoding format: application/x-qgis
license: no-permission
sd date published: 2022-09-02 19:29:06.833916+00:00

HackMD Pangeo Show and Tell
type: Document
type: Resource
type: MediaObject
date created: 2022-09-20 12:05:09.775445+00:00
date modified: 2022-09-20 12:05:11.915234+00:00
description: This is the shared document we use for all the Pangeo Show and Tell. We collect information, Q&A and feedback. Each Show and Tell has its own sub-section.
license: no-permission
sd date published: 2022-09-20 12:05:09.775445+00:00

YAXArrays.jl Documentation
type: Resource
type: MediaObject
type: SoftwareDocumentation
date created: 2022-09-02 19:18:10.607898+00:00
date modified: 2022-09-02 19:18:11.226797+00:00
description: YAXArrays.jl is another xarray-like Julia package. A package for operating on out-of-core labeled arrays, based on stores like NetCDF, Zarr or GDAL. Package Features: - open datasets from a variety of sources (NetCDF, Zarr, ArchGDAL) - interoperability with other named axis packages through YAXArrayBase - efficient mapslices(x) operations on huge multiple arrays, optimized for high-latency data access (object storage, compressed datasets)
license: no-permission
sd date published: 2022-09-02 19:18:10.607898+00:00

ne_50m_admin_0_countries.README.html
type: Document
type: Resource
type: MediaObject
date created: 2022-09-02 19:23:40.734491+00:00
date modified: 2022-09-02 19:24:04.940893+00:00
description: Admin 0 & Countries | Natural Earth
encoding format: text/html
license: no-permission
sd date published: 2022-09-02 19:23:40.734491+00:00

ne_50m_admin_0_countries.VERSION.txt
type: Document
type: Resource
type: MediaObject
date created: 2022-09-02 19:24:56.813174+00:00
date modified: 2022-09-02 19:25:06.654522+00:00
description: Version
encoding format: text/plain
license: no-permission
sd date published: 2022-09-02 19:24:56.813174+00:00

ne_50m_admin_0_countries.cpg
type: Document
type: Resource
type: MediaObject
date created: 2022-09-02 19:26:00.758390+00:00
date modified: 2022-09-02 19:26:01.662704+00:00
description: cpg file from shapefile dataset.
license: no-permission
sd date published: 2022-09-02 19:26:00.758390+00:00

ne_50m_admin_0_countries.prj
type: Dataset
type: Resource
type: MediaObject
date created: 2022-09-02 19:27:59.472971+00:00
date modified: 2022-09-08 09:48:47.785910+00:00
description: Part of ne_50m_admin_0_countries shapefile (projection information).
license: no-permission
sd date published: 2022-09-02 19:27:59.472971+00:00

How to use EarthDataLab.jl to do large scale computations (Jupyter Notebook)
type: Resource
type: MediaObject
type: JupyterNotebook
date created: 2022-09-02 19:19:48.682613+00:00
date modified: 2022-09-02 19:21:25.363815+00:00
description: Jupyter Notebook used by Felix during the Pangeo Show & Tell to demonstrate how to use EarthDataLab.jl to do large scale computations. To execute this Jupyter Notebook, data contained in the "input folder" is needed (please create a folder called "data" in the folder where you have stored the notebook).
license: no-permission
sd date published: 2022-09-02 19:19:48.682613+00:00

Nordic e-Infrastructure Collaboration
type: Organization
type: Agent

https://w3id.org/ro-id/31664cbd-c4a3-4432-8d5c-923a1b25c4f1
type: ResearchObject
type: ForkedRO
type: LiveRO
forked at time: 2022-09-15 07:32:01.063467+00:00

https://w3id.org/ro-id/77a61d94-3318-4d33-a3c0-4730e7026fdb
type: ResearchObject
type: SnapshotRO
is finalized: False
snapshoted at time: 2022-10-05 11:05:15.777066+00:00

POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))
type: GeoShape
polygon: 6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953

POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))
type: Place

Handling large geo data with Julia
type: ResearchObject
type: LiveRO
type: Dataset
type: ExecutableResearchObject
about: Applied sciences
about: Earth sciences
content size: 165756
date created: 2022-09-02 19:02:01.731061+00:00
date modified: 2025-10-18 11:24:13.424842+00:00
date published: 2022-09-02 19:02:01.731061+00:00
description: This talk is part of the Pangeo Show & Tell series and was given on September 1st 2022 by Felix Cremer. Bio Felix Cremer received his diploma in mathematics from the University of Leipzig in 2014. In 2016 he started his PhD study on time series analysis of hypertemporal Sentinel-1 radar data. He currently works at the Max-Planck-Institute for Biogeochemistry on the development of the JuliaDataCubes ecosystem in the scope of the NFDI4Earth 5 project. Abstract The Earth Data Lab (EDL) is a data cube framework in Julia for the efficient handling of raster data. It is based on the YAXArrays.jl package. YAXArrays.jl provides functionality to deal with labelled arrays, similar to the xarray python package and it also provides efficient and easy multithreading and distributed computation of user defined functions along arbitrary slices of the data. EarthDataLab.jl uses DiskArrays.jl in the backend to deal with out of memory datasets. In this Show-and-Tell Felix is going to give a short introduction into the EarthDataLab.jl package for raster data handling in Julia.
encoding format: application/ld+json
keywords: geodata
keywords: julia
license: no-permission
main entity: Video
publisher: Nordic e-Infrastructure Collaboration
creation mode: MANUAL
cite-as: Felix Cremer, and Pangeo Europe. "Handling large geo data with Julia." ROHub. Sep 02 ,2022. https://w3id.org/ro-id/a802f7dc-f3f4-4eac-b69f-748fb90958fb.

Felix Cremer
type: Agent
affiliation: Max-Planck-Institute (Germany)

biblio
type: Folder
type: Dataset
has part: Pangeo discourse post announcing 1st September Show & Tell by Felix Cremer.
has part: YAXArrays.jl Documentation

output
type: Folder
type: Dataset
has part: HackMD Pangeo Show and Tell
has part: Youtube video "Handling large geo data with julia by Felix Cremer."

tool
type: Folder
type: Dataset
has part: ESDLtutorial Github repository.
has part: How to use EarthDataLab.jl to do large scale computations (Jupyter Notebook)

input
type: Folder
type: Dataset
has part: ne_50m_admin_0_countries.dbf
has part: ne_50m_admin_0_countries.shp
has part: ne_50m_admin_0_countries.shx
has part: ne_50m_admin_0_countries.README.html
has part: ne_50m_admin_0_countries.VERSION.txt
has part: ne_50m_admin_0_countries.cpg
has part: ne_50m_admin_0_countries.prj

Pangeo
type: community
description: A community platform for Big Data geoscience

on Sep-1-2022
type: TimeReference

handling
type: Lemma
norm score: 12.694877505567929
score: 5.7

geo data
type: Phrase
norm score: 19.469026548672566
score: 8.8

memory dataset
type: Phrase
norm score: 14.823008849557521
score: 6.7

dataset
type: Lemma
norm score: 10.244988864142538
score: 4.6

calculation
type: Concept
norm score: 7.662835249042146
score: 4.0

multithreading
type: Concept
norm score: 6.8965517241379315
score: 3.6

Plovdiv
type: Place
wikidata: Q459

treatment
type: Concept
norm score: 15.708812260536398
score: 8.2

earth sciences
type: FieldOfResearch
norm score: 100.0
score: 0.9773926138877869

other earth sciences
type: FieldOfResearch
norm score: 100.0
score: 0.9773926138877869

in 2014
type: TimeReference

The Earth Data Lab (EDL) is a data cube framework in Julia for the efficient handling of raster data.
type: Sentence
norm score: 31.934731934731936
score: 13.7

computer operations and hardware
type: NASA
norm score: 100.0
score: 0.9168391823768616

time series
type: Concept
norm score: 10.727969348659006
score: 5.6

YAXArrays.jl
type: Lemma
norm score: 13.585746102449889
score: 6.1

database
type: Domain
norm score: 48.453608247422686
score: 4.7

raster data
type: Lemma
norm score: 13.14031180400891
score: 5.9

Felix Cremer
type: Lemma
norm score: 15.367483296213809
score: 6.9

In this Show-and-Tell Felix is going to give a short introduction into the EarthDataLab.jl package for raster data handling in Julia.
type: Sentence
norm score: 35.1981351981352
score: 15.1

mathematical and computer sciences
type: NASA
norm score: 100.0
score: 0.9168391823768616

series analysis
type: Phrase
norm score: 15.044247787610619
score: 6.8

raster data handling
type: Phrase
norm score: 26.106194690265486
score: 11.8

functionality
type: Concept
norm score: 8.045977011494253
score: 4.2

data
type: Lemma
norm score: 18.262806236080177
score: 8.2

In 2016
type: TimeReference

EarthDataLab.jl
type: Lemma
norm score: 16.70378619153675
score: 7.5

dataset
type: Concept
norm score: 12.452107279693488
score: 6.5

data
type: Concept
norm score: 21.839080459770116
score: 11.4

Science and technology
type: IPTC
path: Science and technology

parcel
type: Concept
norm score: 8.812260536398467
score: 4.6

This talk is part of the Pangeo Show & Tell series and was given on September 1st 2022 by Felix Cremer.
type: Sentence
norm score: 32.86713286713287
score: 14.1

YAXArrays.jl package
type: Phrase
norm score: 24.557522123893804
score: 11.1

diploma
type: Concept
norm score: 7.854406130268199
score: 4.1

computer science
type: Domain
norm score: 51.54639175257732
score: 5.0

Library and museum
type: IPTC
path: Arts, culture and entertainment/Culture/Library and museum

https://w3id.org/ro-id/a802f7dc-f3f4-4eac-b69f-748fb90958fb/abe09580-1113-4c77-a7d9-71f181341daf
type: Geometry
type: Polygon
as WKT: POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))

plot_italy_julia_pangeo_ST.png
type: Sketch
type: Resource
type: MediaObject
content size: 138593
date created: 2022-09-02 19:30:37.195378+00:00
date modified: 2022-09-08 09:49:59.092719+00:00
description: Plot from the Julia Jupyter notebook.
encoding format: image/png
license: no-permission
sd date published: 2022-09-02 19:30:37.195378+00:00

Youtube video "Handling large geo data with julia by Felix Cremer."
type: Resource
type: MediaObject
type: VideoObject
date created: 2022-09-02 19:13:04.311770+00:00
date modified: 2022-09-02 19:32:10.440106+00:00
description: This is the recorded talk from Felix Cremer during the Pangeo Show & Tell in September 1st, 2022. Felix is going through his Julia Notebook and explain us about handling large geo data with Julia.
license: no-permission
sd date published: 2022-09-02 19:13:04.311770+00:00

Bohdan Bilun
type: Agent

service-account-enrichment
type: Agent