Project
ANR-16-CE33-0015 : National Research Agency. Accepted in June 2016
Name
Field-Oriented Layered Dynamics animating 3D characters
Acronym
FOLD-Dyn
Type
Fundamental research - Collaborative project
Duration
48 month, beginning 22/01/2016, ending 21/01/2021
Coordinator
Loïc Barthe
Address
IRIT-CNRS UMR 5505 - Université Paul Sabatier
118, Route de Narbonne
31062 Toulouse Cedex 9, France
Contact
0033 (0)5 6155 6312 - Loic.Barthe@irit.fr
mysefl

Presentation

The FOLD­Dyn project proposes the study of new theoretical approaches for the effective generation of virtual characters deformations, when they are animated. These deformations are two­folds: character skin deformations (skinning) and garment simulations. When producing an animation movie, either for the cinema, television/online series or communication, these deformations are complex to compute and their creation requires hours of work from several specialized artists. In addition, the insertion of garment simulations in animation software requires the use of specific approaches in order to fit correctly within the code and then, in the production pipeline of animation studios. As a result, except for very realistic virtual characters interacting with real characters for live footage in movies, and for main virtual characters in 3D productions with a high budget, garment simulations are avoided and character deformations are rudimentary. In fact, most of the time, garments are rather deformed using simpler techniques, borrowed from skin deformations (and potentially identical), and these, despite very close partnerships between industrial and academic members in this community, which allows fast technological transfers when new promising approaches are discovered by researchers.

We propose to explore the possibilities offered by a novel theoretical way of addressing character deformations: the implicit skinning. This method jointly uses meshes (the standard representation for 3D animations) and volumetric scalar functions (an unusual representation in this community). The strength of this approach is to provide effective solutions when meshes reach their limits by exploiting, in these situations, the promising natural properties of 3D scalar functions, such as their ability to generate multiple collision­free iso­surfaces. By improving the theoretical properties of scalar functions, the study of their joint use with meshes, and the introduction of a new approach and its formalism ­ called multi­layer 3D scalar functions ­ we aim at finding effective solutions allowing production studios to easily integrate in their pipeline plausible character deformations together with garment simulations. Such solutions would have a very significant impact on the realism of the final animations as well as on the quality and the visual attractiveness of the movies. From the academic point of view, the impact will be even more important since this research is a scientific break with the current approaches and they offer new perspectives that were considered as extremely challenging to reach so far.

This fundamental research project is carried out by an academic consortium formed of specialists in the fields of 3D modeling and animation, garment simulation and more specifically 3D scalar functions for virtual environments. They are members of the Institut de Recherche en Informatique de Toulouse, Inria Grenoble Rhône Alpes and Inria Bordeaux Sud­Ouest. In order to guaranty the relevance of the research directions and the usability of the proposed results, this academic consortium will closely collaborate with industrial experts from the 3D animation industry: TeamTo production studios and the animation software developers from Mercenaries Engineers.


Preliminary works introducing and supporting the project:

2014 R. Vaillant, G. Guennebaud, L. Barthe, M.P. Cani and B. Wyvill. "Robust Iso-Surface Tracking for Interactive Character Skinning", ACM Transactions on Graphics, 33(6), proc. of ACM SIGGRAPH ASIA, 2014. [pdf] [video] [vimeo] [YouTube] [transfer] [more]

2013 R. Vaillant, L. Barthe, G. Guennebaud, M.P. Cani, D. Rhomer, B. Wyvill, O. Gourmel and M. Paulin. "Implicit Skinning: Real-Time Skin Deformation with Contact Modeling", ACM Transactions on Graphics, 32(4), proc. of ACM SIGGRAPH, 2013. [pdf] [video] [vimeo] [YouTube] [transfer] [free codes] [more]

top

Academic Consortium

Name
First Name
Position
Affiliation
Barthe
Loïc
Professor
IRIT - Université de Toulouse - France
Paulin
Mathias
Professor
IRIT - Université de Toulouse - France
Vanderhaeghe
David
Associate Professor
IRIT - Université de Toulouse - France
Cani
Marie-Paule
Professor
LIX - Polytechnique - France
Rohmer
Damien
Associate Professor
Inria Rhône-Alpes
Guennebaud
Gaël
Researcher (CR1)
INRIA Bordeaux Sud-Ouest - France
Bénard
Pierre
Associate Professor
LaBRI - INRIA Bordeaux Sud-Ouest - France


Industrial Collaborators

Name
First Name
Position
Affiliation
Lehuédé
Albéric
Project Manager
TeamTo - France
Spieser
Jean-Baptiste
Technical Director
TeamTo - France
Berthet
Sébastien
R&D Engineer
TeamTo - France
Corvazier
Cyril
CTO, Lead R&D Engineer
Mercenaries Engineering - France
Potier
Guillaume
R&D Engineer
Mercenaries Engineering - France


Members in the project

Name
First Name
Position
Affiliation
Relation
Canezin
Florian
Engineer
IRIT - Université de Toulouse - France
funded by the ANR FOLD-Dyn project
Buffet
Thomas
Internship - PhD
Grenoble University / Lix - France
funded by the ANR FOLD-Dyn project


Partners around the project

Name
First Name
Position
Affiliation
Relation
Wyvill
Brian
Professor
University of Victoria - Canada
Andrea
Tagliasacchi
Professor
University of Victoria - Canada
Riccardo
Scateni
Professor
University of Cagliari - Italie
Mellado
Nicolas
Researcher
CNRS - IRIT - France
Roussellet
Valentin
PhD student
IRIT/CIMI - Université de Toulouse - France
funded by the CIMI Labex
Aburumman
Nadine
Post-doc
IRIT/CIMI - Université de Toulouse - France
funded by the CIMI Labex
Maurizio
Kovacic
PhD student
IRIT - Université de Toulouse - France / University of Victoria - Canada
co-supervised by Brian Wyvill
Baptiste
Angles
PhD student
IRIT - Université de Toulouse - France / University of Victoria - Canada
co-supervised by Brian Wyvill and Andrea Tagliasacchi
Sara
Casti
PhD student
University of Cagliari - Italie
co-supervised by Ricardo Scateni
top

Results

Sketch-based composition of implicit models

We introduce new gradient-based composition operator for combining implicit surfaces. The free-form shape linking the combined objects is inferred from a user sketches (Siggraph Asia 2017).

by Baptiste Angles et al. (see also STORM's YouTube Channel).

top

Publications

Journals

2017 B. Angles, M. Tarini, B. Wyvill, L. Barthe, A. Tagliasacchi. "Sketch-Based Implicit Blending", ACM Transactions on Graphics, 36(6), proc. of ACM SIGGRAPH ASIA, 2017. [pdf] [YouTube]



Posters and Communications

2017 V. Roussellet. "Scalar fields and secondary motion in character animation", Presented at Eurographics 2017's Doctoral Consortium.

2016 V. Roussellet, N. Mellado, L. Barthe. "Implicit-based secondary motion for character animation", Presented at j.FIG 2016, Best paper award - second price.

top

Transfer

  • Elastic Implicit Skinning: We have developed a demonstration software for our skinning technique published at Siggraph Asia 2014. It will distributed soon !

top

Mediation: Large public and scholars

  • 2017 - Nov. : CNRS communication on our Siggraph Asia 2017 publication : “Sketch-Based Implicit Blending” by Baptiste Angles et al.. See the advert here and the article here.

  • 2017 - July : Lecture of 21h on shape deformations for digital animation for Master and PhD students given at the University of Cagliari (Italie).

top

Press & Visibility

top