The library robots_txt is dual-licensed under Apache 2.0 and MIT terms. The library robots_txt is copyright 2017, Robots_txt Developers.