blogng/blog/2019-01-08-recurse-center-day-#-2.markdown
Dhananjay Balan 58b20109cf Convert from old categories to tags
import sys
import yaml

with open(sys.argv[1]) as fp:
    data = fp.read()

if not data.find("---") == 0:
    # no head
    print("NO YAML HEAD FOUND")
    sys.exit(-1)

data = data[3:]
head_end = data.find("---")

head = data[0:head_end]
data = data[head_end+3:]

metadata = yaml.safe_load(head)

cats = metadata.pop('categories', None)
if cats != None:
    if type(cats) == list:
        tags = cats
    elif type(cats) == str:
        tags = cats.split()

    tags = list(map(lambda t: t.lower(), tags))

    metadata["tags"] = ", ".join(tags)
    new_data = f"---\n{yaml.dump(metadata, default_flow_style=False)}---{data}"
    # write it
    print(f"coverted: categories to tags: {tags} - {sys.argv[1]}")
    with open(sys.argv[1], "w") as fp:
        fp.write(new_data)
    sys.exit(0)

if not metadata.get("tags", None):
    metadata["tags"] = "untagged"
    new_data = f"---\n{yaml.dump(metadata, default_flow_style=False)}---{data}"
    print(f"untagged: {sys.argv[1]}")
    # write it
    with open(sys.argv[1], "w") as fp:
        fp.write(new_data)
    sys.exit(0)

print("No changes needed")
2019-01-28 17:16:27 -05:00

64 lines
3.3 KiB
Markdown

---
comments: true
date: 2019-01-08
layout: post
tags: rc, freebsd, haskell
title: 'Misplaced inodes - Recurse Center Day # 2'
---
I am part of the Winter 2 batch of [RC](https://recurse.com) and today is day
#2!
One of the (many!!) things I wanted to do at RC was to write more here, but
turns out neglect had broken the code a bit. This blog is generated from bunch
of markdown files using [hakyll](https://jaspervdj.be/hakyll/) and I was no longer able to build it on my laptop. At this point I should mention that my laptop is running `FreeBSD 13-CURRENT r342798`.
## Errors
As most haskell projects, build is managed by [stack](https://docs.haskellstack.org/en/stable/README/). On a good day `stack build` is all one need to build the project. stack takes care of setting up the compiler, downloading imported libraries and so on.
Not today..
```
Cabal-simple_mPHDZzAJ_1.24.2.0_ghc-8.0.2: No cabal file found.
Please create a package description file <pkgname>.cabal
```
That's weird, also not very helpful - because it has nothing do with the code I wrote.
## Knee-Jerk solutions
My first thought after the usual fast solutions (updating stack and moving to a newer lts etc) was to ditch stack altogether and use cabal to build the
package, this proved to be a bit risky because I have haskell packages (like
xmonad) installed using `pkg(7)` from freebsd package repo, and cabal was not
happy about them. I could have maybe made it work with sandboxes but I am not
familiar with them and decided to keep that as a backup plan.
## Reproducing errors
Next step was to reproduce the error on a smaller project, turns out `stack new
test && cd test && stack build` raises the same error. So its not the code base
but the entire toolchain that's broken 😰
Armed with this information and web-search-foo lead me to this [github issue](https://github.com/commercialhaskell/stack/issues/3515), and one key work stood out `ino64` change.
[`inodes`](http://www.grymoire.com/Unix/Inodes.html) are datastructures that hold metadata information about an object in the filesystem. FreeBSD used to use 32bit value to hold this limiting number of objects you could have in the file system to 2^32. [ino64 change expands this to 64bit](https://lists.freebsd.org/pipermail/freebsd-fs/2017-April/024684.html). However this made all pre-compiled ghc versions stack downloads incompatible with FreeBSD versions >= 12.
Since inode structures are different ghc was somehow not able find files! 🛑
## The solution
Even though there is a patch landed for this problem in stack, it didn't make it
to the latest release `v1.9.3`.
So I opted to use the system-ghc for my build by adding following in `stack.yaml`
```
system-ghc: true
```
However this line doesn't have any effect unless you are on a `resolver` that uses the system ghc version, so I downgraded the resolver to `lts-12.26` that uses `ghc version 8.4.4` installed from ports.
And ... builds are back! 🥳
## Reflections
1. The `stack` fix is landed on master, so next release should fix it (I did not test it).
2. A fellow freebsd haskeller suggested looking at [ghcup](https://github.com/haskell/ghcup), they don't support FreeBSD atm, but I like the idea of having a lightweight tool to manage different ghc versions.
3. `stack` is ports is outdated (`v1.7.1`) and seems to be unmaintained, I should probably try to fix it. 🙂