Main Page

UNIDAPT Group (UNIversal aDAPTation) has been created by Dr. Grigori Fursin in 2004 to revisit current over-complicated, under-performing and power-hungry computing technology, and develop self-tuning, adaptive computing systems based on empirical automatic code/architecture optimization and statistical, collective and machine learning techniques. Since March, 2010, Grigori and his UNIDAPT team joined EXATEC Lab in France (Intel Labs Europe/CEA/GENCI/UVSQ). More information will be available through the official communication channels of the new Lab.

It may not always be visible to the IT users, but developing and optimizing new computing systems using current technology is too time consuming and costly. Hence, we are developing a new methodology to automate and simplify the process of developing and optimizing new computer architectures, compilers, operating systems and programming environments using statistical analysis, machine learning, dynamic adaptation and bio-inspired techniques. We believe that our adaptive approaches are critical to overcome the complexity of computing systems and improve their performance, power consumption, system size and fault-tolerance automatically while reducing their cost and time to market. We hope that our techniques will boost innovation in bio-informatics, medicine, physics, aeronautics, robotics, chemistry, finances, image/video processing and other important areas that demand ever-increasing computing resources while placing strict requirements on systems.

• Current design of our Collective Optimization Framework (http://cTuning.org):

• Major Publications:
  • HiPEAC'09/TACO, MICRO'09, PLDI'10/HiPEAC'07, GCC Summit'08, CGO'07, HiPEAC'05, CPE'04, All

• Main achievements:
  • Moved empirical automatic performance tuning, iterative optimization (compilation), statistical and machine learning techniques to real production compilers and computing systems, and started the whole system parametrization and abstraction to enable future self-tuning, adaptive computing systems. Designed Collective Tuning Center (cTuning.org) and led the development of the first publicly available machine learning enabled self-tuning compiler based on automatic correlation between program features, run-time behavior and optimizations (MILEPOST GCC (with MILEPOST colleagues) and cTuning CC) focusing at the moment on improving program execution time, code size, compilation time, power consumption and enabling run-time adaptation. Though this system is still in a preliminary state, we showed for the first time how to substitute the whole human-tuned state-of-the-art optimization heuristic of a production compiler with the automatically learned one across multiple programs and architectures using empirical iterative and collective optimization, program features and predictive modeling. cTuning/MILEPOST technology revolutionizes code and architecture design and optimization, helps to reduce power consumption and time to market for new computing systems, and is now used by major companies and in large US, EU and other international R&D projects. All developed tools have been released as open-source to the community to continue collaborative R&D to automate and simplify code and architecture design and optimization, enable sharing of optimization cases and improve the quality of academic research. cTuning/MILEPOST technology opens up many research opportunities, so it's an on-going, evolving project with many R&D topics available. Current collaborative projects include automating fine-grain/polyhedral optimizations, parallelization and run-time optimization and adaptation using statistical and machine learning techniques.

• • Participated in the preparation of the HiPEAC research vision (2012-2020) (reviewing and writing parts on automatic self-adaptation, split-compilation and collective optimization).
  • Initiated the International Workshop Series on Statistical and Machine learning approaches to ARchitecture and compilaTion (SMART) together with my colleagues from the University of Edinburgh.
  • Developed multiple practical techniques to speed up iterative feedback-directed optimization and enable run-time adaptation for statically compiled programs based on code cloning, dynamic low-overhead monitoring of program behavior and reaction to its changes; enabled predictive scheduling for heterogeneous multicore systems; developed portable program characterization techniques based on reactions to optimizations, adaptive libraries based on dataset characterization using machine learning and decision trees, empirical architecture design space exploration, transparent statistical collective optimization, etc (Publications).

• Current collaboration:
  • Intel, Université de Versailles-Saint-Quentin-en-Yvelines (France), GENCI, CEA, ICT (China), CAPS Enterprise, University of Edinburgh (UK), IBM, STMicroelectronics, UIUC (USA), UPC (Spain), Ghent University (Belgium) ...

• Major developments:
  • Collective Tuning Center (cTuning.org), Collective Optimization Database, Optimization Prediction Web-Service - community-driven collaborative center to share optimization cases and develop R&D tools with common APIs for self-tuning adaptive computing systems (including programs, compilers, run-time systems, architectures) based on empirical optimization, run-time adaptation, statistical collective optimization and machine learning.
  • cTuning CC - free, open source compiler collection that combines multiple tools and techniques including MILEPOST GCC, ICI, CCC framework, cTuning web-services and Collective Optimization Database and cBench as the first practical step toward self-tuning, adaptive computing systems based on industrial tools, empirical techniques, transparent collective optimization, statistical analysis and machine learning.
  • MILEPOST GCC - first publicly available open-source machine learning enabled compiler that that correlates program features and optimizations during empirical learning to predict good optimization for unseen programs. It opens up many new research opportunities.
  • Interactive Compilation Interface - high-level common compiler independent research API and low-level event-driven plugin system to “hijack” production compilers and transform them into extensible interactive research optimization toolsets. We participated in discussions on GCC low-level plugin framework and added some of the ICI to the mainline GCC 4.5.
  • CCC and UNIDAPT framework - extensible framework to automate iterative compilation and enable run-time adaptation for statically compiled programs.
  • cBench/MiDataSets - collection of open source programs and datasets for realistic research on program optimization and performance evaluation.

• Dissemination:
  • We co-founded the SMART workshop series on statistical and machine learning approaches to architectures and compilation.
  • We organize M.S. course on Future Computing Systems.
  • We gave several invited talks at IBM, Intel and a number of other companies and universities about automating code and architecture optimizations as well as enabling self-tuning intelligent adaptive computing systems.

• Motivation example:

Example of complex optimization search spaces for susan_c from cBench after using CCC framework and MILEPOST GCC 4.4.0 developed by UNIDAPT Group:

Example of program similarities based on static program features and based on best found program optimizations from the cTuning optimization repository that improve execution time:

Milepost GCC combined with cTuning technology helps to correlate program features and optimizations using various machine learning techniques to quickly predict good optimizations for a previously unseen program.

• Members:
  • Head of the UNIDAPT Group: Dr. Grigori Fursin (also Project Leader at the new Exascale Research Center).
  • List of all members.
  • Info and requirements to join our group.

If you would like to contact or visit us you can find more details here.