This is a text-only version of the following page on https://raymii.org:
---
Title       : 	Firefox History stats with Bash
Author      : 	Remy van Elst
Date        : 	25-09-2016
URL         : 	https://raymii.org/s/snippets/Firefox_History_Stats_with_Bash.html
Format      : 	Markdown/HTML
---



This is a small script to gather some statistics from your Firefox history.
First we use sqlite3 to parse the Firefox history database and get the last
three months, then we remove all the IP addresses and port numbers and finally
we sort and count it.

<p class="ad"> <b>Recently I removed all Google Ads from this site due to their invasive tracking, as well as Google Analytics. Please, if you found this content useful, consider a small donation using any of the options below:</b><br><br> <a href="https://leafnode.nl">I'm developing an open source monitoring app called  Leaf Node Monitoring, for windows, linux & android. Go check it out!</a><br><br> <a href="https://github.com/sponsors/RaymiiOrg/">Consider sponsoring me on Github. It means the world to me if you show your appreciation and you'll help pay the server costs.</a><br><br> <a href="https://www.digitalocean.com/?refcode=7435ae6b8212">You can also sponsor me by getting a Digital Ocean VPS. With this referral link you'll get $100 credit for 60 days. </a><br><br> </p>


    
    
    #!/bin/bash
    if [[ ! -d ${HOME}/.www ]]; then
      mkdir ${HOME}/.www/
    fi
    
    cp "$(find "${HOME}/.mozilla/firefox/" -name "places.sqlite" | head -n 1)" "${HOME}/.www/places.sqlite"
    sqlite3 "${HOME}/.www/places.sqlite" "SELECT url FROM moz_places, moz_historyvisits \
                           WHERE moz_places.id = moz_historyvisits.place_id \
                                 and visit_date > strftime('%s','now','-3 month')*1000000 ORDER by \
                           visit_date;"  > "${HOME}/.www/urls-unsorted"
    sort -u "${HOME}/.www/urls-unsorted" > "${HOME}/.www/urls"
    
    awk -F/ '{print $3}' "${HOME}/.www/urls" | grep -v -E -e '[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}' -e ':.*' -e '^$' | sed -e 's/www\.//g' |sort | uniq -c | sort -n 
    

Example output:

    
    
        383 lowendtalk.com
        534 reddit.com
        569 google.com
        574 github.com
        792 encrypted.google.com
        973 i.imgur.com
       1458 next.duckduckgo.com
       3009 duckduckgo.com
       6459 wiki.int
      12934 management.int
    

If you just want HTTPS domains, or just HTTP you can use awk to make that
happen:

    
    
    awk -F/ '$1 == "https:" {print $3}' "${HOME}/.www/urls" | grep -v -E -e '[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}' | sort | uniq -c | sort
    

   [1]: https://www.digitalocean.com/?refcode=7435ae6b8212

---

License:
All the text on this website is free as in freedom unless stated otherwise. 
This means you can use it in any way you want, you can copy it, change it 
the way you like and republish it, as long as you release the (modified) 
content under the same license to give others the same freedoms you've got 
and place my name and a link to this site with the article as source.

This site uses Google Analytics for statistics and Google Adwords for 
advertisements. You are tracked and Google knows everything about you. 
Use an adblocker like ublock-origin if you don't want it.

All the code on this website is licensed under the GNU GPL v3 license 
unless already licensed under a license which does not allows this form 
of licensing or if another license is stated on that page / in that software:

    This program is free software: you can redistribute it and/or modify
    it under the terms of the GNU General Public License as published by
    the Free Software Foundation, either version 3 of the License, or
    (at your option) any later version.

    This program is distributed in the hope that it will be useful,
    but WITHOUT ANY WARRANTY; without even the implied warranty of
    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    GNU General Public License for more details.

    You should have received a copy of the GNU General Public License
    along with this program.  If not, see <http://www.gnu.org/licenses/>.

Just to be clear, the information on this website is for meant for educational 
purposes and you use it at your own risk. I do not take responsibility if you 
screw something up. Use common sense, do not 'rm -rf /' as root for example. 
If you have any questions then do not hesitate to contact me.

See https://raymii.org/s/static/About.html for details.