Back to Table of contents

Primeur weekly 2018-05-07

Quantum computing

Portland State receives NSF grant to battle cyber-security threats ...

Picking one photon out of the flow ...

Focus on Europe

Spring 2018 edition of the e-IRG Magazine available ...

Middleware

Software System Award honours Project Jupyter Team ...

Hardware

Cray reports first quarter 2018 financial results ...

Cavium announces ThunderX2 general availability ...

NetSpeed and Esperanto partner to power SoCs for Artificial Intelligence ...

UltraSoC analytics IP selected by Esperanto Technologies for RISC-V many-core parallel processing in AI and ML applications ...

Design for magneto-electric device may improve your memory ...

Cavium announces availability of driver to support NVMe over fibre channel ...

Supermicro launches new look all-flash 1U server with 256TB of hot-swap NVMe optimized Intel "Ruler" drives ...

Applications

CIRES expert and NIST colleagues discover electroplated rhenium's unexpected superconductive characteristics ...

Supercomputer simulations reveal new "Achilles heel" in dengue virus ...

Nanodiamond turns into controllable light source ...

Catching mantle plumes by their magma tails - Deep Earth imaging supported by XSEDE resources ...

Nine research teams receive GLCPC allocations on Blue Waters ...

NCSA announces 2018-19 Blue Waters Graduate Fellows ...

Eni achieves breakthrough in oil & gas reservoir numerical modelling with HPC4 supercomputer ...

The Cloud

Cisco sets new standard for production grade Kubernetes, enabling enterprises to confidently deliver technology innovation faster with AppDynamics and Cisco CloudCenter ...

Bright Computing signs X-ISS as reseller and services partner ...

Software System Award honours Project Jupyter Team


Fernando Pérez
2 May 2018 Berkeley - The Project Jupyter team has been honoured with an Association of Computing Machinery (ACM) Software System Award for developing a tool that has had a lasting influence on computing. Project Jupyter evolved from IPython, an effort pioneered by Fernando Pérez, an assistant professor of statistics at UC Berkeley and staff scientist in the Usable Software Systems Group in Lawrence Berkeley National Laboratory's Computational Research Division.

The award and a prize of $35,000 will be presented to the team at the ACM Awards banquet in San Francisco on June 23, 2018.

Project Jupyter is an open, international collaboration that develops tools for interactive computing: a process of human computer interplay for scientific exploration and data analysis. The collaboration develops applications such as the widely popular Jupyter Notebook, an open-source web app that allows users to create and share documents that contain live code, equations, visualizations and narrative text.

Today, more than 2 million Jupyter Notebooks are hosted on the popular GitHub service, covering technical documentation to course materials, books and academic publication. Jupyter has been transformative in scientific collaborations and reproducibility, as exemplified by its use at the LIGO observatory, whose discovery of gravitational waves was recognized with the 2017 Nobel Prize in Physics. The LIGO Open Science Center publishes Jupyter Notebooks that allow anyone to replicate their original analyses. Jupyter Notebooks also serves as a core infrastructure for research endeavours like the Department of Energy (DOE)-funded KBase platform for predictive biology, the GenePattern Notebook project from the Broad Institute and UC San Diego and the European Union-funded OpenDreamKit project that is building virtual research environments for mathematics.

JupyterHub supports the deployment of Jupyter tools in multiuser environments, from small research groups to universities, companies and other organisations. JupyterHub is used in numerous commercial companies, research at facilities such as CERN and high-performance computing centres like DOE's National Energy Research Scientific Computing Center (NERSC) and San Diego Supercomputer Center (SDSC).

"The flexibility of the Jupyter architecture makes it easy to deploy in a variety of scenarios: while individual users can run the tools on a personal laptop or workstation, the same tools can be deployed on remote resources", stated Shane Canon, a project engineer at NERSC. "In fact, NERSC offers Jupyter as an interactive tool for remote access to its supercomputing resources."

At UC Berkeley two new courses Foundations of Data Science and Principles and Techniques of Data Science, will be supported by Jupyter Notebooks deployed in the Cloud and integrated with campus authentication. The courses are being offered as part of UC Berkeley's new data science major. Fernando Pérez will be teaching the upper-division course "Principles and Techniques of Data Science".

In industry, the Jupyter Notebook is widely used as a daily computation and data-analysis tool, and major companies have created hosted services based on Jupyter. Google's Cloud DataLab, Microsoft's Notebooks on Azure and IBM's Data Science Experience all offer Jupyter Notebooks on their respective Cloud infrastructure.

In education, at least 45 different courses use Jupyter Notebooks to teach a wide variety of subjects, including high-school level Computer Science, Aerodynamics, Numerical Methods, Statistics, Computational Physics, Cognitive Science and Data Science. These have been deployed at leading universities in the U.S. and abroad, including UC Berkeley, Cal Poly, MIT, Harvard, Columbia and Imperial College.

As a graduate student studying physics at the University of Colorado in the early 2000s, Fernando Pérez remembered using a hodgepodge of software systems to illustrate code, equations, visualizations and text in his scientific computing papers. This inspired him to create a unified environment for scientific computing. He found researchers around the globe that had all independently started building scientific computing tools in Python and combined these disparate efforts into one open-source platform called IPython - "I" for interactive. The programme was free, and anyone could inspect its code, modify it and make the output available under liberal licensing terms.

Over the years, IPython evolved to meet the needs of various communities and in 2014 project rebranded itself as "Jupyter" to recognize the fact that it was no longer just for Python. In 2015, Fernando Pérez and Brian Granger of California Polytechnic University, San Luis Obispo received $6 million from the Leona M. and Harry B. Helmsley Charitable Trust, Alfred P. Sloan Foundation and Gordon and Betty Moore Foundation to expand and improve the capabilities of the Jupyter Notebook.

Since then, Fernando Pérez and Brian Granger have secured additional funding from other sources like the DOE and industry partners like Google, Microsoft and Anaconda Inc. Companies such as Bloomberg, IBM, Microsoft, Netflix, Rackspace and Anaconda also support the project, either with services or with the time of engineers who actively contribute to Jupyter's development. The next-generation user interface for the Jupyter Notebook, known as JupyterLab, is currently being developed in an open collaboration with team members and engineers from Bloomberg and Anaconda.

"One afternoon in late 2001, I was a physics graduate student at the University of Colorado working on my dissertation and decided to spend an afternoon writing the original, tiny version of IPython", stated Fernando Pérez. "I could not have imagined that this would grow into a worldwide platform almost two decades later. For me, it's been a wild ride, made possible by going from a personal exploration to an open collaboration with an incredible team."

"This is a project that has demonstrated 20 years of intellectual contributions with major impact in research, education and industry, and it continues to make its advances available to the world as an open platform", stated Kathy Yelick, Associate Laboratory Director of Berkeley Lab Computing Sciences. "The ACM System Software Award is an incredible honour, and this team is entirely deserving of this recognition."

In addition to Fernando Pérez, other members of the Jupyter Project collaboration include Brian E. Granger and Carol Willing, Cal Poly San Luis Obispo; Matthias Bussonnier, UC Berkeley BIDS; Paul Ivanov and Jason Grout, Bloomberg; Thomas Kluyver, European XFEL; Damián Avila, Anaconda Inc.; Steven Silvester, JP Morgan Chase; Jonathan Frederic, Google; Kyle Kelley, Netflix; Jessica Hamrick, DeepMind; Sylvain Corlay, QuantStack; and Peter Parente, Valassis Digital.

Source: Lawrence Berkeley National Laboratory

Back to Table of contents

Primeur weekly 2018-05-07

Quantum computing

Portland State receives NSF grant to battle cyber-security threats ...

Picking one photon out of the flow ...

Focus on Europe

Spring 2018 edition of the e-IRG Magazine available ...

Middleware

Software System Award honours Project Jupyter Team ...

Hardware

Cray reports first quarter 2018 financial results ...

Cavium announces ThunderX2 general availability ...

NetSpeed and Esperanto partner to power SoCs for Artificial Intelligence ...

UltraSoC analytics IP selected by Esperanto Technologies for RISC-V many-core parallel processing in AI and ML applications ...

Design for magneto-electric device may improve your memory ...

Cavium announces availability of driver to support NVMe over fibre channel ...

Supermicro launches new look all-flash 1U server with 256TB of hot-swap NVMe optimized Intel "Ruler" drives ...

Applications

CIRES expert and NIST colleagues discover electroplated rhenium's unexpected superconductive characteristics ...

Supercomputer simulations reveal new "Achilles heel" in dengue virus ...

Nanodiamond turns into controllable light source ...

Catching mantle plumes by their magma tails - Deep Earth imaging supported by XSEDE resources ...

Nine research teams receive GLCPC allocations on Blue Waters ...

NCSA announces 2018-19 Blue Waters Graduate Fellows ...

Eni achieves breakthrough in oil & gas reservoir numerical modelling with HPC4 supercomputer ...

The Cloud

Cisco sets new standard for production grade Kubernetes, enabling enterprises to confidently deliver technology innovation faster with AppDynamics and Cisco CloudCenter ...

Bright Computing signs X-ISS as reseller and services partner ...