Send URLs to the Wayback Machine.
HTTPotion.start()
ExWaybackArchiver.save(["http://example.com"])
Add the following to your project :deps list:
{:wayback_archiver, "~>0.0.1"},
{:ibrowse, github: "cmullaparthi/ibrowse", tag: "v4.1.2"}
This is the first program I ever written in Elixir. Contributions, feedback and suggestions of any kind are very welcome.
- Fork it
- Create your feature branch (
git checkout -b my-new-feature
) - Commit your changes (
git commit -am 'Add some feature'
) - Push to the branch (
git push origin my-new-feature
) - Create new Pull Request
- Implement a proper crawler (current implementation just grabs URLs from the first page)
- Expand relative URLs
- Spawn processes
- Wayback Machine archiver
- Spawn processes