GWDG @ PyCon DE & PyData Berlin 2023

Four of our colleagues of AG Computing had a fantastic time at the PyCon DE & PyData Berlin 2023. During the three days at the conference, a diverse set of topics related to Python and data science was addressed. Here we want to share our experience and highlights of the conference. We did not have the chance to be present in all those fantastic talks, and we look forward to learning more from the conference recordings. As far as the recordings are available, we will update this article accordingly.

Opening Session. Source: Hauke Kirchner

Hauke

The “Kuppelsaal” of the Berlin Congress Center. Source: Hauke Kirchner

After the opening, the first day ever at a PyCon/PyData conference started for me with the great tutorial Accelerate Python with Julia by Stephan Sahm. Here practical examples demonstrate how one can achieve a significant speed-up for your code without too much overhead of work. One highlight of the second day was the talk Visualizing your computer vision data is not a luxury, it’s a necessity: without it, your models are blind and so do you. by Chazareix Arnault. During his talk, he showed fascinating examples of complicated situations in image data sets (such as weird realities). Further, he suggested tools for visualizing image data, such as opencv, Jupyter Widgets, FiftyOne, and Streamlit. The conference concluded with excellent talks about Accelerating Python Code by Jens Nie and The Beauty of ZARR by Sanket Verma. Finally, an inspiring talk was given by Jens Agerberg, who took us to the field of topological data analysis with his talk Teaching Neural Networks a Sense of Geometry.

Tino

PyCon DE & PyData Berlin 2023 was a great experience for us as Data Scientists from the GWDG. We had the opportunity to attend a variety of workshops and talks from some of the most influential figures in the world of data science. As a result, we were able to learn about the latest trends and technologies in the field, as well as gain valuable insights from experienced professionals. Additionally, we were able to network with other data scientists and build relationships with potential users.

The event was well-organized, and the atmosphere was buzzing with enthusiasm. We also got hands-on experience with the latest tools and technologies, which was extremely useful. Developers and users of various Python packages presented their experiences with state-of-the-art Big Data and Data Science solutions.

Most exciting takeaways for me:

  • Received a detailed overview of Management tools for Python Packages and environments, which is vital for some current projects at AG C
  • PyG as a promising tool for building graph neural networks (GNNs) and what the plans of the developers are
  • Rust in Python: High potential for speed up among a lot of overhead in engineering and stability problems with state-of-the-art tools.

Overall, the PyCon DE & PyData Berlin 2023 was an enriching experience.

Timon

As both an administrator and DevOps engineer, I was particularly excited to learn about the latest advancements in the Python language presented during the conference, as a chance to learn more about them directly from industry professionals. Also, I was of course very interested in the newest tools and applications that were presented and the new development concepts therein.

For that reason, I was very impressed by the keynote Towards Learned Database Systems by Prof. Carsten Binnig that was given on the second day of the conference. In this keynote, he presented his working groups ideas of introducing machine-learning algorithms into the heuristical analysis components of relational-database systems, where they can, for example, be used to dramatically improve calculation speeds of index-building and query-execution-plan calculations. Furthermore, I was very impressed by the talk Specifying behavior with Protocols, Typeclasses or Traits. Who wears it better (Python, Scala 3, Rust)? by Kolja Maier, which was a very interesting introduction into the typing.Protocol concept of Python and how it relates to Traits in Scala and Rust. It really helped with my understanding of the concept in general and I will surely use this feature in future coding projects. Lastly, the talk Monorepos in Python was especially interesting for the DevOps engineer in me, as it provided a insightful overview over ways to manage monorepos inside a CI/CD pipeline, and offered practical tips on when to use and avoid them.

Overall, the PyCon DE & PyData Berlin 2023 conference was an excellent opportunity to learn and grow, and I am grateful to have attended.

Dorothea

3 days. More than 100 talks, keynotes, workshops and most of all: A deep dive into an huge community of data scientist, data engineers and data-anythings. The PyCon 2023 was amazing to learn about new libaries, new approaches to challenges anyone faces working with data and to network. Among many great talks, some left me re-evaluating and reflecting on a conceptual level:

Overall, it was an inspiring conference and I would recommend anyone to use their coffee-break for browsing through slides, code or listen to the recorded talks – see the links below.

Unordered collection of links from the conference website and Discord

Not for all talks enough seats were available. Luckily cozy chairs with a great view were available. Source: Hauke Kirchner

This list needs to be completed as it only captures the links for talks we were present at. This list will grow when we have the chance to watch some more recordings of the talks. If you want to contribute some more links, reach out to hauke.kirchner@gwdg.de.

Avanindra Kumar Pandeya: FastAPI and Celery: Building Reliable Web Applications with TDD

Description
slides and code

Valerio Maggio: Actionable Machine Learning in the Browser with PyScript

description
slides

Noa Tamir: Keynote – How Are We Managing? Data Teams Management IRL

Description
slides

Guido Imperiale: Data-driven design for the Dask scheduler

description
slides

samsja: Modern typed python: dive into a mature ecosystem from web dev to machine learning

Decription
slides

Yuichiro Tachibana: Streamlit meets WebAssembly – stlite

description
slides

Christopher Prohm: Pragmatic ways of using Rust in your data project

description
slides and code

Noa Tamir, Patrick Hoefler: Let’s contribute to pandas

slides
code

Thomas Bierhance: Polars – make the switch to lightning-fast dataframes

descriptions
slides

Lisa Andreevna Chalaguine: How to teach NLP to a newbie & get them started on their first project

description
newer course from discourd

Susan Shu Chang: Keynote – A journey through 4 industries with Python: Python’s versatile problem-solving toolkit

description
slides

Cheuk Ting Ho: Driving down the Memray lane – Profiling your data science work

description
slides
code

Stephan Sahm: Accelerate Python with Julia

description
code

Stephan Sahm: Accelerate Python with Julia

description
code

Martin Christen: Geospatial Data Processing in Python: A Comprehensive Tutorial

description
code

Marcus Tedesco: Neo4j graph databases for climate policy

description
slides

KIlian Kluge: Grokking Anchors: Uncovering What a Machine-Learning Model Relies On

description
slides

Lev Konstantinovskiy: Prompt Engineering 101: Beginner intro to LangChain, the shovel of our ChatGPT gold rush.

description
slides

Aleksander Molak: The Battle of Giants: Causality vs NLP => From Theory to Practice

description
slides
book
additional materials

Jens Nie: Accelerating Python Code

description
code / presentation
code (benchmark)

Jeremy Tuloup: Create interactive Jupyter websites with JupyterLite

description
code

Sanket Verma: The Beauty of Zarr

description
slides
code

Author

Dorothea Sommer | Tino Meisel | Timon Vogt | Hauke Kirchner

Categories

Archives

--