Scraping Gdpr Fines
Into the DOM with a flavour of regex
Posted on April 8, 2020
(Last modified on November 9, 2022)
| 4 minutes
| 774 words
| Roel M. Hogervorst
The website Privacy Affairs keeps a list of fines related to GDPR. I heard * that this might be an interesting dataset for TidyTuesdays and so I scraped it. The dataset contains at this moment 250 fines given out for GDPR violations and is last updated (according to the website) on 31 March 2020.
All data is from official government sources, such as official reports of national Data Protection Authorities.
[Read More]Setting up CSP on your hugo (+netlify) site
Content security policy is being nice to your readers browser
Posted on March 13, 2019
(Last modified on November 9, 2022)
| 4 minutes
| 706 words
| Roel M. Hogervorst
I recently got a compliment about having a content security policy (CSP) on my blog.
But I’m not special, you can have one too!
In this post I will show you how I created this policy and how you can too. I’m using the service report-uri.com which automates a lot the work. This is specific for building a hugo site using netlify. I am absolutely no expert and so this is mostly a description of what I did.
[Read More]Graphing My Daily Phone Use
Posted on January 28, 2019
(Last modified on November 9, 2022)
| 3 minutes
| 527 words
| Roel M. Hogervorst
How many times do I look at my phone? I set up a small program on my phone to count the screen activations and logged to a file. In this post I show what went wrong and how to plot the results.
The data I set up a small program on my phone that counts every day how many times I use my phone (to be specific, it counts the times the screen has been activated).
[Read More]Logging my phone use with tasker
Posted on January 28, 2019
(Last modified on November 9, 2022)
| 2 minutes
| 381 words
| Roel M. Hogervorst
In this post I’ll show you how I logged my phone use with tasker, in a follow up post I’ll show you how I visualized that.
I had a great vacation last week but relaxing in Spain I thought about my use of technology and became a bit concerned with how many times I actually look at my phone.
But how many times a day do I actually look at my phone?
[Read More]Running an R script on heroku
Automate alllll the things!
Posted on December 6, 2018
(Last modified on November 9, 2022)
| 3 minutes
| 539 words
| Roel M. Hogervorst
In this post I will show you how to run an R script on heroku every day. This is a continuation of my previous post on tweeting a death from wikidata.
Update 2022: heroku is no longer offering free options.
Why would I want to run a script on heroku? It is extremely simple, you don’t need to spin up a machine in the cloud on AWS, Google, Azure or Nerdalize.
[Read More]Tweeting daily famous deaths from wikidata to twitter with R and docker
A tweet a day keeps the insanity at bay
Posted on November 19, 2018
(Last modified on November 9, 2022)
| 8 minutes
| 1695 words
| Roel M. Hogervorst
In this explainer I walk you through the steps I took to create a twitter bot that tweets daily about people who died on that date.
I created a script that queries wikidata, takes that information and creates a sentence. That sentence is then tweeted.
For example:
A tweet I literally just send out from the docker container
I hope you are has excited as I am about this project.
[Read More]Make more useless packages!
For fun! and like learning, but mostly fun, really...
Posted on August 31, 2018
(Last modified on November 9, 2022)
| 4 minutes
| 646 words
| Roel M. Hogervorst
You should make more useless packages. To be more specific: make packages that are useful to you, but might be useless to others.
Because building silly stuff is fun and sets the bar low for you to play and learn.
I’m a big fan of Simone Giertz (see all the gifs in this post). Simone is known as the ‘Queen of Shitty Robots’ and has a youtube channel where she builds robots that are, uhm, not very good at the thing they’re designed for.
[Read More]How to set up GNU Terry Pratchett on hugo with netlify
Keeping Terry Pratchett alive in static websites
Posted on July 20, 2018
(Last modified on November 9, 2022)
| 3 minutes
| 567 words
| Roel M. Hogervorst
TL;DR:
In this post I will show you how to set up special header information on a static website such as hugo + netlify. Netlify interprets the _headers file and applies the rules to your website. You only have to set a simple rule, and now you too can keep Terry Pratchett alive!
GNU Terry Pratchett On March 12th 2015 one of my favorite writers; Terry Pratchett died, but the people of the internet were not ready to let him go.
[Read More]Moving parts of a country over a map
Posted on January 29, 2018
(Last modified on November 9, 2022)
| 3 minutes
| 618 words
| Roel M. Hogervorst
I love making maps, I also love making gifs. In this short post I make an animated gif of parts of a map moving. In this case the parts of the map only move in the xy direction, but you can also turn them, and make them bigger or smaller. Today I show you how I made a part of the Netherlands ‘float away’. It is part of a larger nonsense project (I have many silly projects), and mostly just to document my path to learning about spatial analytics.
[Read More]Downloading files from a webserver, and failing.
Posted on December 8, 2017
(Last modified on November 9, 2022)
| 5 minutes
| 989 words
| Roel M. Hogervorst
Recently I wanted to download all the transcripts of a podcast (600+ episodes). The transcripts are simple txt files so in a way I am not even ‘web’-scraping but just reading in 600 or so text files which is not really a big deal. I thought.
This post shows you where I went wrong TL:DR : do not assume everything will always work on the internet.
Also here is a picture I found of scraping.
[Read More]