Tuesday, January 2, 2018

Image Captioning Models and Fabrik

1NeuralTalkhttps://github.com/karpathy/neuraltalkPython + numpyobsoleted by NeuralTalk2
2NeuralTalk2https://github.com/karpathy/neuraltalk2TorchTorch incompatible with Fabriq
3Show and Tellhttps://github.com/tensorflow/models/tree/master/research/im2txtTensorflowTensorflow parser Fabriq incompatible with Fabriq
4Keras Image Captionhttps://github.com/LemonATsu/Keras-Image-CaptionKeras
requires python 3.4+
fail with python 3.6
5 https://github.com/amaiasalvador/imcap_kerasKerasperlu MSCOCO
6Neural Image Captioninghttps://github.com/oarriaga/neural_image_captioningKerasTimeDistributed Layer incompatible with 

I want to add an Image Captioning model to Fabrik. It seems pretty easy, all you have to do is find a JSON format of the model you want, and there you go! All done. But in reality, it wasn't that easy.

First, I have to find an image captioning mode. My first choice landed to NeuralTalk since it's pretty popular. After heading to the GitHub page, it seems like NeuralTalk is obsoleted by NeuralTalk2, so I take NeuralTalk2 After having a hard time trying to install it and trying to make the JSON file, I realized something. NeuralTalk2 use torch as its framework and Fabrik doesn't support torch. Fabrik only supports Caffe, Keras, and Tensorflow. (I never made the JSON file by the way)

I have to try another model. I ended up trying Neural Image Captioning by oarriaga on github. Unlike NeuralTalk2, making the JSON file was pretty smooth. 
So I try to find another model. Show and Tell looks good. It uses Tensorflow as its framework, but unfortunately Fabrik <><><>< so I have to find another model

1 comment:

  1. 188bet Casino – Free Bets, No Deposit Bonuses, Cashbacks
    188bet is a casino that was established in 11bet 2015. It was launched in 2017 and has since 188bet grown to become a reliable site dafabet for players to bet. The site


Simple Image Classification with Keras

Keras logo There are several kind of image classification: Binary classification Multiclass classification Multi label classificat...