How to configure and install vim from source?

Vim 8.0 has been released some weeks ago and maybe you want to install it. Sometimes, binaries in packages are often not up-to-date or configure with python. Here the command to install it from source with python et python3 options (useful if you use YouCompleteMe):

git clone https://github.com/vim/vim
cd vim
./configure --enable-pythoninterp --enable-python3interp
make
sudo make install

You can also add other options. You can list them with:

./configure --help

OCaml + Cordova = more secured, typed and hybrid mobile applications.

Since several months, I began to be interested in mobile development. I found a job in Brussels in July 2015 where I learned how to develop hybrid mobile applications (one code = available for multiple mobile platforms) with Cordova and web technologies. I found it very interesting and after several month I continue to develop applications with this technology. I discovered a very great community about mobile development and some awesome frameworks like Ionic.

The majority of these frameworks use JavaScript as programming language but I don’t really like this language because you have no types, some weird things (equality between string and integer), parameters are sent as undefined if not passed, etc. I don’t really like to develop applications with JavaScript because it’s very ugly (even if I think it’s OK for prototyping, but not in production).

I discovered OCaml at the university, a very powerful programming language with inferred static type, type checking at compilation time, an extraordinary community and… a compiler from OCaml to JavaScript! So, I wanted to use this language to develop mobile applications with Cordova: it will be my university project for a semester.

The goal of my project is to be able to use native components of smartphones such like accelerometer, camera, send sms, etc in OCaml.

What are Cordova, js_of_ocaml and gen_js_api?

  • Cordova allows you to develop hybrid mobile applications using web technologies such as HTML, CSS and JavaScript. For more information, see the official website. Through Cordova plugins, you can access to the native components. To learn how to make Cordova plugins, see the official tutorial. You can find the official Cordova plugin list here.
  • js_of_ocaml provides a compiler from OCaml to JavaScript. Since Cordova applications use JavaScript, js_of_ocaml provides a way to develop mobile application using OCaml. For more info, see the Ocsigen project which contains js_of_ocaml.
  • gen_js_api aims at simplifying the creation of OCaml bindings for JavaScript libraries. It must currently be used with the js_of_ocaml compiler, although other ways to run OCaml code “against” JavaScript might be supported later with the same binding definitions (for instance, Bucklescript, or direct embedding of a JS engine in a native OCaml application).

All bindings are developed with gen_js_api and aims to be functional, typed and very close to the JavaScript interface.

Continue reading

Ocsigen: how to compile an Eliom project. Understand the compilation process in deep.

It’s time to write my first article on Ocsigen and especially on Eliom. I began a week ago my internship in BeSport, a social network centralized on sports and entirely developed in OCaml using the Ocsigen projects so I needed to learn how Ocsigen works in general.

Ocsigen? What’s that? It’s an atom no?

Yes, oxygen is a chemical element but Ocsigen is also an OCaml web framework began in 2004.

Wait, another web framework? There are plenty of existing web frameworks.

Yeah, I agree. But Ocsigen is different in some cases. First, Ocsigen is entirely written in OCaml: no PHP, no JavaScript, no HTML. Second, Ocsigen contains independent «small» projects which, together, form a very elegant framework. Here some of these sub-projects:

  • Ocsigenserver: web server entirely written in OCaml. It supports HTTPS, multiple hosts (virtual hosts), proxy, content compression, access control, authentication, etc. Everything you need is implemented and very easy to configure. Ocsigenserver allows you to develop modules to add functionalities to the server.
  • Js_of_ocaml: a compiler OCaml bytecode to JavaScript. It allows you to write OCaml program and to compile it in JavaScript so you can write web application entirely in OCaml.
  • Eliom: a high level library to build client side and server side applications. In few lines of code and in the same file, you can write complex websites and the server side associated. It uses the strong OCaml type system to create route, html pages, data exchange, session mechanisms, etc. It uses new concepts in web programming which are very interesting and are up-to-date with modern needed.
  • Lwt: cooperative programming in OCaml. It’s popular in the OCaml community even in non-web project.
  • TyXML: write typed XML tree (in particular HTML).
  • and more… You can find all Ocsigen sub-projects here

OCaml on Raspberry Pi

This morning, I wanted to play with my Raspberry Pi which is, since a long time, not used. After downloading the last raspbian image and installing it with dd (see here), I wanted to make some scripts, to do some programming. I read some articles like this one from Jane Street installing OCaml on a Raspberry Pi and doing some coding stuff with Async. So, I had my morning project: install OCaml and opam on my Raspberry Pi 1 model B+ along with opam packages.

Installing OCaml

The first step is to install some dependencies like git and m4 to be able to install opam. Normally, git is pre-installed but not m4.

sudo apt-get install m4

After that, OCaml 4.01.0 has a package and can be installed with apt-get:

sudo apt-get install ocaml

The installation takes a few minutes but after that, we can use OCaml without problem.

OCaml on Raspberry Pi

OCaml on Raspberry Pi

Clone, compile and install opam

It’s time to be able to use opam to install our favorite packages. We will install opam from source to have an optimized installation. We need to configure, install external libraries, compile opam before being finally able to install it. All commands are given on the official github repository:

git clone https://github.com/ocaml/opam
cd opam
./configure
make lib-ext
make
sudo make install

Cloning and configuring are fast. The longest steps are installing external libraries and compiling opam: it takes several minutes.
If you are using a Raspberry pi 3, which has a quad core CPU, you can use

make -j 4

.
These commands will install the last version of OPAM (which is for the moment 2.0) but maybe you want OPAM 1.2. In this case, use:

git clone https://github.com/ocaml/opam
cd opam
git checkout -b 1.2 origin/1.2
./configure
make lib-ext
make
sudo make install

We also need to launch opam init, which takes also several minutes:

opam init

Install the last OCaml version

Before using any package, I would like to switch to a more recent OCaml version, such as the last release: 4.03.0. We can easily do this with opam switch.

opam switch 4.03.0

It takes a very long time because the Raspberry Pi needs to compile OCaml. CPU is always at 100% but it doesn’t take too much RAM, the entire system taking 200 MB max. You will be stuck at this step for a long time.

opam switch 4.03.0 stuck

And after around 1 hour, we have an fresh OCaml 4.03.0 installation on our Raspberry Pi:

ocaml 4.03.0

ocaml 4.03.0

Install an opam package: js_of_ocaml

As a fan of js_of_ocaml, I would like to try it on my Raspberry Pi.

opam install js_of_ocaml

Still no issues with the installation but it takes also a long time due to camlp4 in particular but everything is OK, without any memory issue.

How to set up a multi-language and collaborative wordpress blog

A multi-language and collaborative blog

When I decided to write a blog with WordPress, I had some difficulties choosing to write in French or in English and I would something collaborative.
I decided to begin in English because I thought I would have more visitors and it would be a good writing exercise.

After some days and searches about French blogs, I figured out that there were a lot of French blogs without English translations. Some argue they wanted to keep a French community and others because they don’t have knowledge to write in English.

Besides these reasons, I found some bad quality articles and I wanted to improve that.

So, it was finally decided! I’ll write in both French and English.
I know I won’t be able to write in both languages, and I’ll make a lot of errors in English.

Addicted to the open source philosophy, I found a solution which is to put my articles on a collaborative platform such as GitHub and allow pull requests from people to improve my articles. On top of that, my articles could be easily translated in other languages.

Here are two plugins I found to setup a collaborative and multi-language blog.

It’s not a tutorial to learn how to use these plugins. There’re plenty of tutorial on the web.

Multi language: Polylang

The first step is to install a plugin to allow to redact in several languages. I chose Polylang because it’s easy to install and doesn’t perform persistent changes.

Collaborative: WordPress Github Sync

GitHub is a good platform to share our code, and it’s the platform I chose.
After some searches about a plugin which allows to export and import from GitHub, I found WordPress Github Sync.
It’s also easy to install and it’s very simple to use.

Merge these two plugins

I wasn’t entirely satisfied when I began to use them. Individually, it’s perfect, but there’re some inconveniences when you try to export to GitHub the same article written in French and in English.
By default, WordPress GitHub Sync exports as Y-m-d-article_name. The problem is you have to look at the article name to know which language is. I wanted something like lang-article_name, the date isn’t important for me.

I decided to modify the GitHub plugins (which can be found here). It exports as lang-article_name by parsing the permalink (supposed to be in the form http://domain/lang/article_name).
I added a get_lang method into the post.php file and changed the github_filename method.

The result can be found on my GitHub: dannywillems, and my articles in this repository

How to set up a mobile build server: step 3

  1. Introduction
  2. Server-side and client-side: (Optional) Create and configure an user on the build server
  3. Server-side: Install and configure the Android SDK
  4. Server-side: Install and configure cordova/ionic
  5. Client-side: Automate the build process

Server-side: Install and configure cordova/ionic

This step will be very short. We would like to install globally cordova and/or ionic without root privileges. By default, we need to use sudo with npm install -g (to install globally).
We can avoid these root command by changing the directory where the npm packages are installed.

Each command is executed on the server

Change npm packages installation directory

The new directory will be in your home and called .npm-packages. Create the directory and change the npm prefix by using

mkdir -p ~/.npm-packages
npm config set prefix "~/.npm-packages"

The executable files like cordova and ionic will now be in ~/.npm-packages/bin. We need to add this directory to your PATH to be able to use directly the command.

echo "export PATH=$PATH:~/.npm-packages/bin" >> ~/.${SHELL##*/}rc

You need to reload your shell configuration. You can do it by closing and reopening your terminal or by using the command

source ~/.${SHELL##*/}rc

Before continuing, check you have the directory ~/.npm-packages/bin in your PATH with

echo $PATH

Install cordova and ionic without root privileges

Now, we can install cordova and/or ionic. Here, we will install only cordova.

npm install -g cordova

What’s next?

It’s time to write our build script.

Go to the last part (coming soon). I’m working on several projects now, I don’t have time to write this last part.

Script

You can download it here.

How to set up a mobile build server: step 2

  1. Introduction
  2. Server-side and client-side: (Optional) Create and configure an user on the build server
  3. Server-side: Install and configure the Android SDK
  4. Server-side: Install and configure cordova/ionic
  5. Client-side: Automate the build process

Server-side: Install and configure the Android SDK

It’s time now to install the Android SDK with the command line interface.

If you want to set up a build server for Mac OS X, you only need to download XCode and the iOS SDK will be downloaded. For LaTeX, see the appropriate install section for your distribution. At the end, some links will be listed for more informations about these alternatives

Each commands must be executed on the server so first connect you on the server.

Download and install the Android SDK

Go to the Android website to download the SDK. Copy the link for the Linux version and use wget.
The actual version is r24.4.1, so the command is

    wget http://dl.google.com/android/android-sdk_r24.4.1-linux.tgz -O /tmp/android-sdk.tgz
I wrote a small python script which parse the html page and get the link of the most recent SDK version. Download it

We extract the android sdk into a new hidden directory in the home named .android-sdk.

    mkdir -p ~/.android-sdk
    tar xvf /tmp/android-sdk.tgz -C ~/.android-sdk

Configure the PATH

Now we have to add the android executables such as android (SDK Manager) and adb to the PATH. An ANDROID_HOME variable is also necessary.

    echo "ANDROID_HOME=~/.android-sdk/android-sdk-linux" >> ~/.${SHELL##*/}rc
    echo "PATH=$PATH:~/.android-sdk/android-sdk-linux/tools:~/.android-sdk/android-sdk-linux/platform-tools" >> ~/.${SHELL##*/}rc

Reload your shell configuration file with

    source ~/.${SHELL##*/}rc

to update the PATH for the current ssh session.

Choose SDK API to install

SDK is installed and the PATH is configured. Now we have to install which SDK versions we want to install.

The SDK manager can be managed with the android command. By default, it launched the SDK Manager window.
To use the SDK manager in command line, you have to add the –no-ui at the end of each andoid command.

For example, to list all sdk versions, you use

    android list sdk --no-ui

and you get a similar output than

Screen Shot 2015-12-31 at 22.02.53

The numbered list in the output let you choose which SDK API you want to install with the command android update sdk -u -a -t .

First we update the sdk with the command

    android update sdk --no-ui

Accept the licence and as it’s the first time you launch this command, it will download the last Android SDK API (Now: Android 6.0 ie API 23).

If you want to install more SDK API, use

    android update sdk -u -a -t <package no.>

where is the number in the previous numbered list. (-u is a shortcut –no-ui, -t for filters and -a for all, see android -h).

With my previous screenshot, if you want to install the API for Android 5.1.1 (API 22), you use

    android update sdk -u -a -t 4

Install the API you want.

And now ?

The SDK is installed, only using the command line. Great !
Now it’s time to configure cordova and ionic. It would be a small step.

Go to the third part

Script

Download it. Don’t forget: it’s a server-side script !

How to set up a mobile build server: step 1

  1. Introduction
  2. Server-side and client-side: (Optional) Create and configure an user on the build server
  3. Server-side: Install and configure the Android SDK
  4. Server-side: Install and configure cordova/ionic
  5. Client-side: Automate the build process

Server-side and client-side: (Optional) Create and configure an user on the build server

In this part, we will create a new user and configure ssh access. It’s an optional part because you can use an existing user.
I chose to separate the user because I think an user on a server must create for only one thing.
On top of that, as I said in the introduction, this method can be used for a C, LaTeX (or anything else) build server. An user for each build method is better in this case.

The user will be called android-sdk.

It’s the only part of this tutorial you need root access to create the user

Server-side: Create the user

Connect to the server and create a new user:

adduser android-sdk

You’ll be prompted for some informations such as a name, full name, and a password.

Client-side: create a ssh key and add it to the server

To avoid having to type the password each time we push, we create a ssh key and add it to the android-sdk’s authorized keys.

ssh-keygen -t rsa -f ~/.ssh/android-sdk
ssh-copy-id -i ~/.ssh/android-sdk android-sdk@[your-server]
Replace [your-server] by your server ip/alias/domain name. If you’re on Mac OS X, install ssh-copy-id with brew (brew install ssh-copy-id).
It’s recommended to have different ssh keys for each ssh user that is for github.com, bitbucket.com or other users on your server.

Client-side: add a rule in the ssh config

If you followed the previous command, you must add a rule in the ~/.ssh/config file to match the appropriate ssh key file.
Open with your favorite text editor (vim of course :D) and add these lines

Host build-server
Hostname [your-server-adress/ip/alias]
IdentityFile ~/.ssh/android-sdk
User android-sdk
See this excellent tutorial for more informations about the ssh config file. Don’t forget to change the user if you’re using another user. Same for the ssh key file.

The host will be used when you’ll clone the repository. You will use somethink like

git clone android-sdk@build-server:~/my_amazing_project.git

Scripts

As promised, I give you scripts to automate the configuration. There’re two scripts: one for the server and one on the client machine.

Server

We only need to create the user. I only add a variable to let you choose your user name.

## Change it if you want another username.
## Don't forget to change in the client script too.
USERNAME = android-sdk

## DON'T EDIT THESE FOLLOWING LINES
adduser $USERNAME
##

Client

We need to create a ssh key, add the ssh key to the server and modify the ssh config file. If you changed the username in the script server.

##### Change it if you want another username.
## Don't forget to change in the server script too.
## [default = android-sdk]
USERNAME = android-sdk

## Your server IP adress or alias
HOSTNAME = danny-willems.be

## The host name you want to use when you'll clone
## [default = build-server]
HOST = build-server

## SSH key name
## [default = android-sdk]
SSH_KEY_NAME = android-sdk

## DON'T EDIT THESE FOLLOWING LINES
## Create SSH keys
ssh-keygen -t rsa -f ~/.ssh/$SSH_KEY_NAME

## Copy to the server
ssh-copy-id -i ~/.ssh/$SSH_KEY_NAME $USERNAME@$HOSTNAME

## Modify the ssh config file
echo 'Host $HOSTn Hostname $HOSTNAMEn IdentityFile ~/.ssh/$SSH_KEY_NAMEn User $USERNAME' >> ~/.ssh/config

And now ?

OK, user configured. Now, let’s download and install the Android SDK in our new user environment.

Go to the second part

How to set up a mobile build server

Why a mobile build server ?

To develop mobile applications whether for Android, iOS, Tizen or Windows Phone, we need to use the SDK for the appropriate platform. The size of these SDK is more than 1Go for the basics and it can reach around 10-15Go if we download sdk for different versions.

Frequently, in a company, several developers works on a mobile project and it’s very annoying to download the SDK on each workstation. An other case it’s when you work with different OS or different computers: you need to download the SDK multiple times.

Centralized the SDK

A solution is to install the SDK only once on a server which will compile and build the archive for the platform. A mobile project will be in a git repository which will be on the server. The project will be compiled and the archive will be sent to the developer. It will follow this simple process:

  1. Server-side: Create a git repository on the server
  2. Client-side: Clone the repository, work on it, commit and push.
  3. Client-side: Execute a script which will build the project on the server and copy locally the remote archive (apk, ipa, etc).

I will present this solution for the Android SDK which is the easiest to put in place. More specifically the server will be a solution for decentralized cordova/ionic build system.

No graphical interface is needed. This process could be used on an old server, a raspberry pi or anything else. Just need a terminal.

Wait… Other solutions like a docker container or continuous integration system exist. What’s the difference ?

There’re some docker images like this which does the job. Even if I like docker and use it, we must download the image, run it and it takes some place and resources (not a lot) and we don’t have always these resources.

Generally, continuous integration system provide more than we need. And when we want to modify a behavior, we wast time to learn how it’s working. Also some continuous integration system needs some specific resources requirement.

An other point is this method doesn’t require root privileges (for Android SDK): it could be used independantly by a user.

Last this method works on Mac OS X server and only the build script (see below) must be changed. The Mac OS X script will also be given.

No root privileges required, no need a lot of resources, easy to install and to use, no graphical interface needed.
This tutorial is tested and developed for a ssh server running on Linux with git, wget and npm installed (cordova/ionic).

Now, let’s go !

This “How-To” tutorial will be separated into 3 parts for the server configuration and a script for the client.

  1. Server-side and client-side: (Optional) Create and configure an user on the build server
  2. Server-side: Install and configure the Android SDK
  3. Server-side: Install and configure cordova/ionic
  4. Client-side: Automate the build process

At the end of each part, a script to automate everything will be given.

Important: we can transform the server for another type of compilation such as C, LaTeX, etc with the same idea. We only have to change the username and the client build script.

Go to the first part

GSMath

GSMath: a math hybrid library.

In the same idea than GSLib GSMath is a library, available in multiple languages, keeping the same structure and the same functions. GSMath provides functions to do linear algebra (matrix), differential analysis, basic algebra, trigonometry,…

What’s an hybrid library and why ?

I think programming languages must be seen as a tool, not as a “raw material”.

I don’t say every programming languages is equivalent in the sense there’re no needs to compare them. There’re better programming languages than other, and it depends on what you have to do. There’re also different theoric aspects of programming languages which matters a lot. For example, you’ve to be foolish to code a JQuery like or a web render in brainf***. As a tool, there’re better tools than other (but it’s not the subject of this article, maybe later).

I think a programming language must be seen as a way to communicate with your computer as you want: the compiler or interpreter is there to translate to your machine. So, why do we have to learn a new standard library when we learn a new programming language ? Why do we have to talk differently to each interpreters and compilators ?
It’s not very productive and we don’t often remember basic functions because we have to switch between different syntaxes.

You shouldn’t be afraid about the syntax and the semantic to learn a new programming language or when you work with several languages.

For these reasons, I began to write a library I called GSMath. I say it’s an hybrid library because you can use it in the programming language you want with the same namespace and the same algorithms for the implementation. The last point is I think important because when we want to learn a new programming language, it’s a good way to learn to study how standards libraries are implemented.

GSMath isn’t always the fastest and the more efficient implementations of math libraries.