Wednesday, August 29, 2018

A Density Functional Tight Binding Layer for Deep Learning of Chemical Hamiltonians

Haichen Li, Christopher Collins, Matteus Tanha, Geoffrey J. Gordon, David J. Yaron (2018)
Highlighted by Jan Jensen

There are increasingly many papers on predicting the molecular energy and other properties using machine learning (ML). Most, if not all, use some similarity measure of the molecular structure to structures in the training set when training. This paper uses DFTB Hamiltonian matrix elements instead and treats the short-range matrix elements as adjustable parameters (weights) to be trained. To make this happen, DFTB is implemented as a layer for deep learning, using the TensorFlow deep learning framework, by recasting the DFTB equations in terms of tensor operations. In this way domain knowledge is incorporated into the ML model. Since the starting values are the "conventional" DFTB parameters one can also view this as refining the DFTB method.

This DFTB-ML approach is evaluated on 15,700 hydrocarbons by comparing the RMSE in energy per heavy atom (Eatom) relative to ωB97X/6-31G(d) reference values. Training on up to 7 heavy atoms and testing on 8 heavy atoms, leads to RMS errors in Eatom of 0.72 kcal/mol, compared to 1.80 using conventional DFTB. Training on up to 4 heavy atoms gives an Eatom RMSE of 1.08 kcal/mol. The results can be further improved by using neural networks to allow the matrix elements to depend on the molecular environment of the atoms.

As the authors point out the performance on the training data remained above chemical accuracy (0.5 kcal/mol) for the total molecular energy, but they offer several interesting ideas on how to improve the performance.

This work is licensed under a Creative Commons Attribution 4.0 International License.


  1. It must start with a conviction that an information stockroom would truly support its business and the arrival on speculation will make it justified, despite all the science course in pune

  2. Well, The information which you posted here is very helpful & it is very useful for the needy like me.., Wonderful information you posted here. Thank you so much for helping me out to find the Data analytics course in Mumbai Organisations and introducing reputed stalwarts in the industry dealing with data analyzing & assorting it in a structured and precise manner. Keep up the good work. Looking forward to view more from you.


  3. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. I would like to state about something which creates curiosity in knowing more about it. It is a part of our daily routine life which we usually don`t notice in all the things which turns the dreams in to real experiences. Back from the ages, we have been growing and world is evolving at a pace lying on the shoulder of technology."data science courses" will be a great piece added to the term technology. Cheer for more ideas & innovation which are part of evolution.

  4. Such a very useful article. I have learn some new information.thanks for sharing.
    data scientist course in mumbai