Paris, France, September 23-24, 2024
LAD 24
Like every year, this is a great opportunity for Luster administrators and developers from around the world to gather and exchange their experiences, developments, tools, best practices and much more.
Paris, France, September 25, 2024
Dev Summit’24
Co-located with LAD’24, the Lustre Developer Summit will take place in Paris, on September 25th, 2022. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their work on Lustre..
Bordeaux, France, October 5-6, 2023
LAD 23
Like every year, this is a great opportunity for Luster administrators and developers from around the world to gather and exchange their experiences, developments, tools, best practices and much more.
May 2023
LUG 23
LUG 2023 was held at the Qualcomm Institute at the University of California San Diego (UCSD)Supercomputing Center (SDSC)
January 27, 2023
ISC High-Performance 2023
ISC High-Performance 2023 Location : City of Hamburg, Germany (This year again as an in-person event) Dates: May 21st to May 25th ISC will take place at the brand-new congress center CCH right in the center of the city. For more details visit https://www.isc-hpc.com/
December 15, 2022
EOFS General Assembly 2022
Paris, France, September 27, 2022
LAD 22
Lustre Administrators & Developers Workshop is a great opportunity for worldwide Lustre administrators and developers to gather and exchange their experiences, developments, tools, best practices and more. After 2 years of virtual LADs, we are happy to announce that we will be able to welcome you again in-person this year for this LAD’22 edition! This event willContinue…
Dev Summit’22
Co-located with LAD’22, Lustre Developer Summit will take place in Paris, on September 26th, 2022. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their work on Lustre.
When
One day, September 26th, 2022, from 10:30 to 16:30
Agenda
- 10:30: Coffee
- 11:00: lctl del_ost – Stéphane Thiell
- 11:45: NID to CPT association – Gaël Delbary
- 12:30: Lunch
- 13:30: tests – Peter Jones
- 14:15: Netlink YAML API – James Simmons
- 15:00: Break
- 15:15: Backup/restore of encrypted files without key – Sébastien Buisson
- 16:30: Break, End of Dev Summit
June 2022
ISC High-Performance 2022
ISC 2022 offered 3,007 HPC practitioners, users, and vendors from 59 countries a feeling of community and togetherness after not seeing each other in person for close to three years.
May 2022
LUG 22
The annual LUG conference is the high performance computing industry’s primary venue for discussion on the open source Lustre file system and other technologies. The conference focuses on the latest Lustre developments and allows attendees to network with peers.
LUG 2022 was held as a virtual event, May 9-11, 2022.
November 30, 2021
EOFS General Assembly 2021
The EOFS General Assembly took place on Tuesday, November, 30th, 2021, 15:00 – 17:00. Non-members are welcome to learn about EOFS and a potential membership application.
Agenda
- 15:30 – 15:35 Welcome and Introductio – Frank Baetke (EOFS – for HPE)
- 15:35 – 15:45 Status, Accomplishments, Financial Update – Hugo Falter (ParTec)
- 15:45 – 15:50 Administrative Council (Board) Update – Frank Baetke et al.
- 15:50 – 16:00 GVB Audit – Findings, Decisions, Publication – Frank Baetke
- 16:00 – 16:05 EOFS Financial Statement 2019 Adoption – Hugo Falter, Frank Baetke
- 16:05 – 16:10 Discharge of the EOFS Directors and Board – Frank Baetke et al.
- 16:10 – 16:15 Quorum Status & Elections – Marianne v. Richthofen, Frank Baetke
- 16:15 – 16:20 Technology Section – Member Update – Frank Baetke et al.
- 16:20 – 16:30 BeeGFS – Update – Frank Herold (ThinkParQ)
- 16:30 – 16:40 DAOS – Update – Johann Lombardi (Intel)
- 16:40 – 16:50 LUSTRE – Update – Peter Jones (DDN/Whamcloud)
- 16:50 – 17:00 Miscellaneous and Outlook to 2022 – Hugo Falter, Frank Baetke
- 17:00 – Adjourn
Paris, France, September 28-30, 2021
LAD 21
Lustre Admins & Devs Workshop is a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
To avoid possible inconvenience in the case of a new upsurge in the COVID19 pandemic or due to restrictions on international travels, we find it preferable to make LAD21 a virtual event again this year.
Pre-recorded presentations will be aired online from September 28th to September 30th. To provide maximum coverage of the different time zones, sessions will be broadcast twice a day, once at 8AM UTC (10AM CEST), and once at 4PM UTC (6PM CEST). A chat platform will make it possible to ask questions about presentations, discuss with speakers and other members of the Lustre community.
Thursday, July 1, 2021 Venue virtual
ISC’21 / Lustre BoF
LUSTRE® in HPC, BigData and AI: Status, New Features and Roadmap
Abstract
LUSTRE is the leading open-source and open-development file system for HPC and now supports many HPC and AI/ML infrastructures even beyond its traditional stronghold in academia and scientific research. Around two-thirds of the top 100 supercomputers use LUSTRE. It is a community-developed technology with contributors from around the world and will become a key component of upcoming Exascale Systems. Beyond research and academic installations it has gained wide adoption in segments like financial services, the energy sector, manufacturing, life sciences and digital content creation. At the ISC 2021 DIGITAL BoF developers, administrators, users and solution providers will gather to discuss the current roadmap, new features, innovative developments and deployments as well as new challenges and the current status of the LUSTRE community that continues to drive LUSTRE forward. We will focus on the recent feature developments and discuss how they will shape the next years of LUSTRE. Examples of important and requested features are: FLR Erasure Coding, Pool Quota, Auto Restriping, Client Encryption etc. We will address benefits, experiences and issues up to LUSTRE 2.14.x but will also discuss features planned for 2.15 and future releases. The session will start with very short presentations about the community and its product LUSTRE. A key part will be a presentation of the LUSTRE roadmap from the current release up to the end of 2022 and related discussion topics with a special focus on features, requirements and challenges. We will also cover how to get involved as a LUSTRE developer/contributor.
Agenda
- Presentation pdf
- Frank Baetke (EOFS / for HPE) / Hugo Falter (EOFS / Partec)
- Kevin Harms (OpenSFS / ANL)
- Sarah Neuwirth (Goethe-University Frankfurt)
- Olaf Gellert (DKRZ)
- Peter Jones (EOFS / Whamcloud-DDN)
- Jacques-Charles Lafoucriere (CEA)
Thursday, July 1, 2021 Venue virtual
ISC’21 / BeeGFS BoF
BeeGFS – Architecture, Innovative Implementations and Development Plans
Contributors
- Frank Baetke (EOFS)
- Peter Braam (ThinkParQ)
- Philipp Falk (ThinkParQ)
- Frank Herold (ThinkParQ GmbH)
- Troy Patterson (ThinkParQ GmbH)
Abstract
BeeGFS is recognized by the HPC community as a highly valued, robust, powerful parallel file system that delivers from small sites, to large scale-out environments.
With its source code being publicly available, along with the continuous support from the community, BeeGFS (developed and delivered globally by ThinkParQ), is seen as an easy-deployable alternative to other file systems.
Led by the BeeGFS development and architectural team, the BoF session will begin with a brief architectural overview of BeeGFS, followed by the product direction and development plans along with the product roadmap.
A member of the BeeGFS community, will lead the final part of the BoF, discussing how a parallel file system accelerates their infrastructure, the processes and testing they undertook in selecting the right solution, and the experiences and challenges they have overcome since deployment.
The audience will be encouraged by the presenters to interact throughout this interactive session by sharing their views and feedback in relation to the product roadmap and development plans. The speakers will also discuss how the community can get more involved with the future development of BeeGFS.
May 19-21, 2021 Venue virtual
LUG20/21
The Lustre User Group (LUG) meeting is the primary venue for discussion and seminars on the Lustre parallel file system. The 2021 Lustre User Group (LUG) virtual conference will be held May 19-21, 2021 and hosted by University of Florida Information Technology (UFIT) in partnership with Open Scalable File Systems (OpenSFS).
Call for Presentations
The LUG Program Committee is particularly seeking presentations on:
- Experiences running the newer community releases (2.12, 2.13, 2.14)
- Experiences using the new Lustre features (Client Data Encryption, OST Pool Quotas, DNEv2, PCC, SSK, DoM, Multi-Rail LNet, etc.)
- Best practices and practical experiences in deploying, monitoring, and operating Lustre (also in the cloud)
- Pushing the boundaries with non-traditional deployments
Submission guidelines
You only need an abstract for the submission process; we will request presentation materials once abstracts are reviewed and selected. Abstracts should be a minimum of 250 words and should provide a clear description of the planned presentation and its goals. All LUG presentations will be 30 minutes (including questions).
The abstract submission deadline is set to Sunday, April 4, 2021, 23:59, AoE “Anywhere on Earth”
The submission web page for LUG 2021 is available at https://easychair.org/conferences/?conf=lug2021 You will need to create a user account on EasyChair if you don’t already have one. Please also see the call for submission at https://easychair.org/cfp/LUG2021
We look forward to seeing you online at LUG 2021!
The LUG 2021 Program Committee
December 15, 2020
EOFS General Assembly 2020
The EOFS General Assembly took place as a virtual event on Tuesday, December 15th 16:30 – 17:30 CET (10:30am – 11:30am EST). Non-members are welcome to learn about EOFS and a potential membership application.
Agenda
- 16:30 – Introduction and agenda – Frank Baetke, EOFS
- 16:35 – Status and accomplishments – Hugo Falter, ParTec
slides - 16:55 – LUSTRE – Looking Back & Ahead – Peter Jones, DDN/Whamcloud
slides - 17:05 – BeeGFS – Looking Back & Ahead – Troy Patterson, ThinkParQ
slides - 17:15 – EOFS Future Plans – Hugo Falter et al.
- 17:25 – Other topics of interest
- 17:30 – Adjourn
Paris, France, October 13-15, 2020
LAD 20
Lustre Admins & Devs Workshop is a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Due to the ongoing pandemic, LAD will be a virtual event this year.
Presentations will be aired using Zoom from October 13th to October 15th. They will be divided into 3 two hours-long sessions, each of which will be broadcast twice: once at 8AM (UTC) and once again at 4PM (UTC).
Denver, USA, Wednesday, Nov 20
ISC’19 / BeeGFS BoF
BeeGFS – Architecture, Innovative Implementations and Development Plans
Chairs
- Frank Herold, CEO of ThinkParQ GmbH
- Frank Baetke, EOFS/representing HPE
- Dirk Peterson, Fred Hutchinson Cancer Research Center
- Jean-François Le Fillâtre, ThinkParQ
Abstract
The open-source parallel file-system BeeGFS is one of the fastest-growing middleware products for HPC and related environments and is often seen as an easy-deployable alternative to the Lustre file-system. It was awarded Best Storage Product or Technology by HPCwire at SC18 and is now gaining acceptance at high-end sites.
Following on from previous BoFs which attracted well over 100 attendees, the SC19 BoF will be split into three sections with the key objective to bring developers, administrators, solution providers, and end-users together to connect, interact, discuss development plans and share their user experiences with the product. Following the success of the BeeGFS BoF at ISC 2018 which attracted around 100 attendees, this BoF will be split into three sections and the key objective is to bring developers, administrators, solution providers, and end-users together to connect, interact, discuss development plans, and share their user experiences with the product.
The BoF will begin with an overview of the latest version of the product by the architecture and development team, followed by a customer who will share experiences with an innovative implementation along with the challenges they had and have overcome since deploying BeeGFS. The architecture and development team will continue and provide an overview of the development plans of the product, where the attendees will be encouraged to interact with the speakers and provide their feedback and opinions on the product direction. All three sections of the BoF will be followed by an open Q&A with the audience.
To further prioritize what the BeeGFS users really want in the product development, there will be a quick survey at the end of the session.
Agenda
- Architecture, Innovative Implementations and Development Plans
Denver, USA, Tuesday, 19 November 2019
ISC’19 / Lustre BoF
Lustre Community BoF: Lustre in HPC, AI, and the Cloud
Chairs
- Stephen Simms, OpenSFS/Indiana University
- Frank Baetke, EOFS
Abstract
Lustre is the leading open-source and open-development file system for HPC. Around two thirds of the top 100 supercomputers use Lustre. It is a community developed technology with contributors from around the world.
Lustre currently supports many HPC infrastructures beyond scientific research, such as financial services, energy, manufacturing and life sciences. Lustre clients are available for a variety of technologies, such as x86, POWER, and Arm. At this BoF, Lustre developers, administrators, and solution providers will gather to discuss recent Lustre developments and challenges, including the role of Lustre in AI and its use in Cloud environments.
Agenda
TBD
- 17:15 Welcome and Agenda – Stephen Simms, Frank Baekte
- 1:15 Adjourn
October 9th, 2019 Venue online
BeeGFS VCM’19
The inaugural BeeGFS Virtual Community Meeting takes place on October 9th and will provide attendees with a comprehensive overview of the latest version of BeeGFS, technology updates, along with a sneak peek of the BeeGFS product plans, delivered by the BeeGFS development team.
Attendees will also hear from innovative BeeGFS users including Clemson University and Moscow Institute of Physics and Technology, who will share their experiences with BeeGFS, and the benefits they have seen and challenges they have overcome since deploying BeeGFS.
Developed with a strong focus on performance and designed for ease of use, simple installation, and management, BeeGFS is one of the leading parallel file systems that continues to grow and gain significant popularity in the community and has evolved into a world-wide valued filesystem offering maximum performance, scalability, high flexibility, and robustness.
The BeeGFS Virtual Community Meeting will be a valuable interactive webinar for all BeeGFS users and partners.
Paris, France, September 23-24, 2019
LAD 19
EOFS and OpenSFS are organizing the 9th European lustre workshop, Lustre Administrator and Developer Workshop. It will take place in Paris, at Cercle National des Armées, during 2 days, the 23th and 24th of September, 2019.
This will be a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Dev Summit’19
Co-located with LAD’19, Lustre Developer Summit will take place in Paris, on September 25th, 2019. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their work on Lustre.
When
One day, September 25th, 2019, from 9:00 to 17:00
Agenda
- 09:00: Coffee
- 09:30: Client-side compression – Anna Fuchs, University of Hamburg
- 11:00: Break
- 11:15: Client-side encryption – Sebastien Buisson, Whamcloud
- 12:30: Lunch
- 14:00: Metadata Writeback Cache Development Status – Nathan Rutman, Cray
- 14:10: Faster Filetree Walking – Nathan Rutman, Cray
- 14:30: LU-10283 – Olaf Weber, HPE, and LU-12574 – Quentin Bouget, CEA
- 14:50: Parallel e2fsck – Li Xi, Whamcloud
- 15:30: Tests – Oleg Drokin, Whamcloud
- 16:15: Break
- 16:30: Lustre Reflink – Li Xi, Whamcloud
Frankfurt, Germany, June 17th, 2019
ISC’19 / Lustre BoF
LUSTRE in HPC and Big Data: Status, New Features and Roadmap
Chairs
- Frank Baetke, EOFS/representing HPE
- Sarp Oral, OpenSFS/ORNL
Abstract
LUSTRE is the leading open source file system for HPC and now supports many HPC and AI/ML infrastructures even beyond its traditional stronghold in academia and scientific research. It has gained wide adoption in segments like financial services, the energy sector, manufacturing, life sciences and digital content creation.
At this year’s ISC BoF developers, administrators, users and solution providers will gather to discuss the current roadmap, new features, innovative developments and deployments as well as new challenges and the current status of the LUSTRE community that continues to drive LUSTRE forward. At the BoF we will focus on the recent feature developments and discuss how they will shape the next years of LUSTRE deployment around the world. Examples of important and requested features are: Small File performance improvements (Data on MDT), Erasure Coding and the ability to leverage multiple network interfaces (Multi-Rail LNet).
We will address benefits, experiences and issues with released versions up to LUSTRE 2.12.x but will also discuss features planned for releases including 2.13 scheduled for the summer of 2019. The session will start with a short introduction given by the EOFS and OpenSFS chairs about the status and structure of the LUSTRE community (including recent and upcoming community events)
The key part will be a presentation of the LUSTRE roadmap from the current release up to the end of 2020 and the related discussion topics with a special focus on the features, requirements and challenges.
Agenda
- 16:00 Welcome and Agenda – Frank Baekte, Stephen Simms
Slides - 16:07 Aspects of LUSTRE and European Perspectives – Hugo Falter, EOFS (ParTec)
Q&A with all participants - 16:35 Important and Requested Feature Developments & Roadmap to 2020/21 – Peter Jones, WhamCloud/DDN
Slides - 16:35 Technical Discussion – Peter Jones, Frank Baetke et al.
Q&A – Technical discussion with all participants - 16:55 Upcoming Community Events – Florent Monjalet, CEA
- 17:00 Adjourn
Denver, USA, Wednesday, Nov 20
ISC’19 / BeeGFS BoF
BeeGFS – Architecture, Innovative Implementations and Development Plans
Chairs
- Frank Herold, CEO of ThinkParQ GmbH
- Frank Baetke, EOFS/representing HPE
- Peter Roesch, Chief Architect and Head of Development at ThinkParQ
Abstract
The open-source parallel file-system BeeGFS is one of the fastest growing middleware products for HPC and other performance-related environments. Originating as FhGFS in 2005 by the Fraunhofer Institute for Industrial Mathematics, BeeGFS (now delivered by ThinkParQ GmbH) has continued to grow and gain significant popularity in the community and has evolved into a world-wide valued filesystem offering maximum scalability, high flexibility, and robustness.
Following the success of the BeeGFS BoF at ISC 2018 which attracted around 100 attendees, this BoF will be split into three sections and the key objective is to bring developers, administrators, solution providers, and end-users together to connect, interact, discuss development plans, and share their user experiences with the product.
The BoF will begin with an overview of the latest version of the product by the architecture and development team, followed by a customer who will share experiences with an innovative implementation along with the challenges they had and have overcome since deploying BeeGFS. The architecture and development team will continue and provide an overview of the development plans of the product, where the attendees will be encouraged to interact with the speakers and provide their feedback and opinions on the product direction. All three sections of the BoF will be followed by an open Q&A with the audience.
To further prioritize what the BeeGFS users really want in the product development, there will be a quick survey at the end of the session.
Agenda
- Architecture, Innovative Implementations and Development Plans
Slides
January 25th, 2019
LRZ (Leibniz HPC-Center of the Bavarian Academy of Sciences)
EOFS General Assembly 2019
The next EOFS General Assembly will take place on Friday, January, 25th, 2019, 10:00 – 16:00, in Munich/Garching, as already announced. As membership is by institution you can and should name a delegate if you cannot attend in person. Note that all EOFS-members can be represented by multiple attendees as well. Non-members are welcome to learn about EOFS and a potential membership application.
Agenda
- 10:00 – Welcome and agenda – Frank Baetke, EOFS – Michael Ott, LRZ
- 10:30 – Status of EOFS, accomplishments and report on the recent audit by GVB – Frank Baetke, EOFS
slides - 11:00 – Review of the EOFS bylaws changes and update on www.lustre.org – Hugo Falter, ParTec
- 11:15 – The European Exascale Project – Hugo Falter, ParTec
slides - 11:35 – The open-source DAOS storage engine – overview & roadmap – Johann Lombardi, Intel
slides - 12:00 – Planned European and WW activities 2019 (LUG, ISC, LAD, SC) – Frank Baetke, EOFS
- 12:15 – Lunch (on site – close to the meeting room)
- 13:00 – Update on BeeGFS as an Open File-System – Frank Herold, ThinkParQ
- 13:15 – Update on the LUSTRE / Roadmap – Peter Jones, DDN/Whamcloud
slides - 13:45 – Election of a new EOFS Administrative Council
- 14:30 – Presentations / Approvals of new members
- 15:00 – Future of EOFS – mission and objectives
- 15:30 – Other topics of interest
- 16:00 – Adjourn
- 16:00 – 17:00 Tour to LRZ’s HPC-center and the new SuperMUC-NG system. Pre-registration is mandatory!
Texas, USA, November 13th, 2018
ISC’18 / Lustre BoF
LUSTRE® in HPC and Emerging Data Markets: Roadmap, Features and Challenges
Chairs
- Sarp Oral, OpenSFS/ORNL
- Frank Baetke, EOFS/representing HPE
Abstract
Lustre is the leading open source file system for HPC. Over 70% of the top 100 supercomputers use Lustre. It is a community developed technology with contributors from around the world. Lustre currently supports many HPC infrastructures beyond scientific research, sch as financial services, oil and gas and advanced manufacturing. Lustre clients are available for variety of technologies, such as x86, POWER, and ARM. At this BOF, Lustre developers, administrators, and solution providers will gather to discuss recent Lustre developments, challenges, and corresponding opportunities for the next 5 years of Lustre, including the role of Lustre in future exascale environments.
Agenda
- 12:15 Welcome and Agenda – Sarp Oral, Frank Baekte
- 12:20 The Future of LUSTRE @ DDN/Whamcloud – Robert Triendl (DDN)
- 12:30 LUSTRE® Roadmap Update – Peter Jones (OpenSFS/LWG – Whamcloud/DDN)
- 12:40 Technical Discussion – Peter Jones et al.
- 1:10 Upcoming LUSTRE® Community Events – Sarp Oral, Frank Baetke
- 1:15 Adjourn
Paris, France, September 24-25, 2018
LAD 18
EOFS and OpenSFS are organizing the eighth european lustre workshop, Lustre Administrator and Developer Workshop. It will take place in Paris, at Marriott Champs Elysees Hotel, during 2 days, the 24th and 25th of September, 2018.
This will be a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Dev Summit’18
Co-located with LAD’18, Lustre Developer Summit will take place at Paris, September 26th, 2018. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their Lustre work.
When
One day, September 26th, 2018, from 9:00 to 17:00
Agenda
- HSM Coordinator (LU-10698) (no slide) – John Hammond, Whamcloud
- Erasure Coding (LU-10911) – Andreas Dilger, Whamcloud
- Maintainers file (LU-11329) – Andreas Dilger, Whamcloud
- OST Pool quotas – Nathan Rutman, Cray
- QoS TBF – Li Xi, Whamcloud
- Contribution of DL-SNAP – Shinji Sumimoto, Fujitsu
- Persistent Client Cache (LU-10092) – Li Xi, Whamcloud
- Metadata Writeback Cache (LU-10938) – Oleg Drokin, Whamcloud
Frankfurt, Germany, June 26th, 2018
ISC’18 / Lustre BoF
Lustre in HPC and Big Data: Roadmap, Features and Challenges
Chairs
- Frank Baetke, EOFS/Hewlett Packard Enterprise
- Sarp Oral, OpenSFS
Abstract
LUSTRE is the leading open source file system for HPC and now supports many HPC infrastructures even beyond its traditional stronghold in academaia and scientific research. It has gained acceptance in segments like financial services, the energy sector, manufacturing, life sciences and digital content creation.
At this year’s ISC BoF developers, administrators and solution providers will gather to discuss the current roadmap, new features, innovative developments and deployments as well as new challenges and the current status of the LUSTRE community that continues to drive LUSTRE forward.
At the BoF we will focus on the recent feature developments and discuss how they will shape the next years of LUSTRE deployment around the world. Examples of important and requested features are Progressive file layouts (PFL), File Level Redundancy (FLR) and the ability to scale metadata servers (Distributed Namespace). We will address benefits, experiences and issues with released versions up to LUSTRE 2.10.x but will also discuss features planned for releases including 2.13 scheduled for end of 2019.
The session will start with a short introduction given by the EOFS and OpenSFS chairs about the status and structure of the LUSTRE community followed by a short summary of the LUSTRE users group meeting (LUG 2018, April 24-26) hosted by Argonne National Laboratory in Illinois, USA.
The key part will be a presentation of the LUSTRE roadmap from the current release up to the end of 2019 and the related discussion topics with a special focus on the features, requirements and challenges.
Agenda
- Welcome and Agenda – Frank Baetke, EOFS
Slides - Update on the Legal Aspects of LUSTRE – Hugo Falter, ParTec
- Recent Developments – Brent Mastenbrook, Intel and Robert Triendl, DDN
- Discussion
- OpenSFS Community Release Update – Peter Jones, Whamcloud
Slides - Discussion
- Upcoming LUSTRE Community Events – Aurelien Degremont, CEA
Frankfurt, Germany, June 26th, 2018
ISC’18 / BeeGFS
BeeGFS – Architecture, Implementation Examples, and Future Development
Chairs
- Frank Herold (ThinkParQ)
- Frank Baetke (EOFS)
Abstract
BeeGFS, a highly scalable parallel file-system has become one of the fastest growing middleware products for HPC and other performance-oriented environments since its start at the Fraunhofer center for HPC in 2005. Today the German company ThinkParQ drives its development and provides worldwide support.
In 2016 BeeGFS became an open-source product in response to rising demand from customers and a more active community that wanted to contribute to further developments. As a European development the initial focus was on Europe, but due to its scalability, flexibility and stability together with its support for mixed architectures, it gained significant popularity beyond Europe in the past years. That became clearly obvious in November 2017 where the first BeeGFS BoF ever at SC17 attracted more than 100 attendees, mostly from the US. Feedback from that session is being incorporated into coming product releases.
At the BoF developers, administrators and end-users will discuss the roadmap and share experiences with the product. It will be divided into three sections which in all cases will be followed by Q&A session with the audience:
The session will start with a short presentation about the latest BeeGFS version, including the long-awaited BeeGFS Windows client and will be complemented by a short customer presentation about firsthand experiences in HPC-production environments and in the final section by an update on future feature developments – again intermixed with Q&A.
To help us further prioritize what BeeGFS users really want there will be a quick survey at the end of the session.
Agenda
- Welcome and Agenda – Frank Herold, ThinkParQ
- Software Defined Parallel Storage – Frank Herold, ThinkParQ
Slides - Discussion
Denver, USA, November 15th, 2017
ISC’17 / Lustre BoF
Lustre Community BOF: Lustre deployments for next 5 years
Chairs
- Frank Baetke, EOFS/Hewlett Packard Enterprise
- Sarp Oral, OpenSFS/Indiana University
Abstract
Lustre is the leading open source file system for HPC and is widely used and in more mission-critical installations. Lustre currently supports many HPC infrastructures beyond its traditional stronghold of scientific research including financial services, oil and gas, advanced manufacturing, and visual effects. At this year’s Community BoF, the worldwide community of developers, administrators, and solution providers will gather to discuss the current status of the Lustre community, OpenSFS and EOFS organizations, and also discuss recent feature developments, new challenges and corresponding opportunities for the next 5 years of Lustre. Summaries of LUG2017 and LAD 2017 will be presented.
Agenda
- 5:15 Welcome and Agenda – Frank Baekte, Sarp Oral
- 5:20 Who belongs to the LUSTRE community – a short assessment – Frank Baekte, Sarp Oral
- Users / Sites using LUSTRE
- Contributors / Developers
- Vendors and VARs
- Organizations promoting LUSTRE (EOFS and OpenSFS)
- Prospects (Potential Users and others who are interested to participate)
- 5:30 Upcoming Lustre Community Events
- LUG 2018, Lustre BoF @ ISC’18, LAD’18
- Lustre Ecosystems 2018
- 5:35 Legal Aspects of LUSTRE – Hugo Falter
- 5:40 The LUSTRE Roadmap – Release Dates and Features – Peter Jones
- 5:45 Directed General Discussion – Presenter: Andreas Dilger. Moderators: Frank Baekte, Sarp Oral
- Data on MDT
- File Level Redundancy
- Client side compression
- Tiered storage with Composite Layouts
- 7:00 Adjourn
Frankfurt, Germany, June 21th, 2017
ISC’17 / Lustre BoF
LUSTRE in HPC & Big Data: Experience, Progress & Issues
Chairs
- Frank Baetke, EOFS/Hewlett Packard Enterprise
- Sarp Oral, OpenSFS
Abstract
LUSTRE in HPC and Big Data: Experience, Progress and Issues Session Leaders: Frank Baetke (Hewlett Packard Enterprise, EOFS Chair), Stephen Simms (Indiana University, OpenSFS Chair) LUSTRE is the leading open source parallel file system for HPC. Since 2011 LUSTRE has transitioned to a community developed file system with many contributors from around the world and it is now more widely used in more mission-critical installations than ever. LUSTRE supports HPC and Data Analytics infrastructures beyond its traditional stronghold of scientific research including financial services, energy, manufacturing, life science and digital content creation. At this year’s LUSTRE BoF at ISC 2017 the worldwide community of LUSTRE developers, administrators and solution providers will gather to discuss innovative developments and deployments, the current roadmap and planned new features. A short summary from the LUSTRE users group meeting (LUG 2016) will also be presented. Beyond commercial versions available from solution providers there will be a special focus on experiences and issues with so-called community releases. The community development model has resulted in significant new features, improved stability and broader adoption. The time until new features become available the community release is an issue that will also be discussed. Because LUSTRE is open-source, such a community release is a natural fit for sites looking for a high performance file system without a high price tag. This is particularly the case for smaller sites working with limited hardware and staff.
Agenda
- Welcome and Agenda – Frank Baetke, HP – Slides
- Communities: EOFS and OpenSFS – Frank Baetke, HP
- Lustre Ownership – Hugo Falter, ParTec
- Lustre and Intel’s new Role – Trish Damkroger, Intel
- Lustre Roadmap – Now and in Future – Adam Roe, Intel – Slides
- Experience with Lustre at DKRZ – Julian Kunkel, DKRZ – Slides
Paris, France, October 4-5, 2017
LAD 17
EOFS and OpenSFS are organizing the seventh european lustre workshop, Lustre Administrator and Developer Workshop. It will take place in Paris, at l’Hôtel des Arts et Métiers, during 2 days, the 4th and 5th of October, 2017.
This will be a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Dev Summit’17
Co-located with LAD’17, Lustre Developer Summit will take place at Paris, October 6th, 2017. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their Lustre work.
When
One day, October 6th, 2017, from 9:00 to 17:00
Agenda
- Lustre & Small I/O, Patrick Farrell, Cray
- Real-Time Dynamic Striping: A policy based striping framework, Li Xi, DDN
- Striping per client or Template striping, Jean-Baptiste Riaux, Intel
- Progress report on Lustre-HSM and proposal for a new design of the coordinator, Quentin Bouget, CEA
- Lustre parallel I/O (PIO): Fulfilling the future, Patrick Farrell, Cray
- Server-side I/O (no slides), Alexey Lyashkov, Cray
Salt Lake City, Utah, USA, November 15th, 2016
ISC’16 / Lustre BoF
Lustre Community BOF: Lustre deployments for next 5 years
Chairs
- Frank Baetke, EOFS/Hewlett Packard Enterprise
- Stephen Simms, OpenSFS/Indiana University
Abstract
At the 2016 Lustre community BOF we will focus on the recent feature developments and discuss how they will shape the next 5 years of Lustre deployment around the world. Progressive file layouts (PFL) and the ability to scale metadata servers (Distributed Namespace) are among such game-changing features. From financial services, oil and gas, advanced manufacturing, to basic sciences, Lustre is at the heart of many HPC infrastructures and must continue to evolve to support new use cases. We will explore these use cases and discuss the Lustre roadmap for meeting the requirements they present.
The session will include a town hall meeting open to all BOF participants. Open Scalable File Systems and the European Open File Systems Cooperative will provide initial discussion topics focusing on a brief set of challenges. The list of challenges will be compiled by the OpenSFS and EOFS by polling the community before the BOF. These challenges will then be posed to our attendants by the BOF session leaders to initiate an open floor discussion for their view of how Lustre needs to evolve to meet these requirements.
Agenda
- 20 min, OpenSFS: Status update
- 20 min, EOFS: Status update
- 20 min, Discussion: Community challenges
Paris, France, September 20-21, 2016
LAD 16
EOFS and OpenSFS are organizing the sixth european lustre workshop, Lustre Administrator and Developer Workshop. It will take place in Paris, at Hotel Renaissance Trocadero, during 2 days, the 20th and 21st of September, 2016.
This will be a great opportunity for Lustre worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Dev Summit’16
Co-located with LAD’16, Lustre Developer Summit will take place at Paris, September 22nd, 2016. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their Lustre work.
When
One day, September 22nd, 2016, from 9:00 to 16:30
Agenda
- Lustre Test System, James Nunez, Intel
- Many core clients and KNL scalability, Grégoire Pichon, Atos & Lustre Performances on KNL, Patrick Farrell, Cray
- Enhanced Adaptive Compression in Lustre, Anna Fuchs, Universität Hamburg
- File Level Redundancy (see backup slides), Andreas Dilger, Intel
- More Efficient Lustre-HSM, Cory Spitz, Cray
- Simple HSM Policy Engine in MDS [No slides], Colin Faber, Seagate
- Network addressing with Multi-Rail [No slides], Alexey Lyashkov, Seagate
Paris, France, September 22-23, 2015
LAD 15
EOFS and OpenSFS are organizing the fifth european lustre workshop, Lustre Administrator and Developer Workshop. It will take place in Paris, at Marriott Champs Elysees Hotel, during 2 days, 22nd and 23rd of September, 2015.
This will be a great opportunity for LustreTM worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Dev Summit’15
Co-located with LAD’15, Lustre Developer Summit will take place at Paris, September 24th, 2015. This is a invitation-only meeting where main Lustre developers present their current projects and developments and discuss about Lustre evolution. This is an important meeting, gathering in one place people from different organizations to exchange about their Lustre work.
When
One day, September 24th, 2015.
Agenda
Covered topics included:
- Status of implementing FEFS functions to Lustre 2.x, Fujitsu
- Support of multiple file system modify RPCs in parallel, Grégoire Pichon, Atos
- Channel Bonding [ Write up ], Olaf Weber, SGI
- File Level Replication, Andreas Dilger, Intel
Reims, France, September 22-23, 2014
LAD 14
EOFS and OpenSFS are organizing the fourth European Lustre Workshop, called Lustre Administrators and Developers Workshop. It will take place in Reims, at Domaine Pommery during 2 days, 22nd and 23rd of September, 2014. This will be a great opportunity for Lustre™ worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Paris, France, September 16-17th, 2013
LAD 13
EOFS and OpenSFS are organizing the fourth European Lustre Workshop, called Lustre Administrators and Developers Workshop. It will take place in Reims, at Domaine Pommery during 2 days, 22nd and 23rd of September, 2014. This will be a great opportunity for Lustre™ worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.
Paris, France, September 16-17th, 2013
LAD 12
EOFS and OpenSFS are organizing the fourth European Lustre Workshop, called Lustre Administrators and Developers Workshop. It will take place in Reims, at Domaine Pommery during 2 days, 22nd and 23rd of September, 2014. This will be a great opportunity for Lustre™ worldwide administrators and developers to gather and exchange their experiences, developments, tools, good practices and more.