Tuesday, January 2, 2018

Image Captioning Models and Fabrik

No
Name
URL
Framework
Note
Fabrik
1NeuralTalkhttps://github.com/karpathy/neuraltalkPython + numpyobsoleted by NeuralTalk2
2NeuralTalk2https://github.com/karpathy/neuraltalk2TorchTorch incompatible with Fabriq
3Show and Tellhttps://github.com/tensorflow/models/tree/master/research/im2txtTensorflowTensorflow parser Fabriq incompatible with Fabriq
4Keras Image Captionhttps://github.com/LemonATsu/Keras-Image-CaptionKeras
requires python 3.4+
fail with python 3.6
5 https://github.com/amaiasalvador/imcap_kerasKerasperlu MSCOCO
6Neural Image Captioninghttps://github.com/oarriaga/neural_image_captioningKerasTimeDistributed Layer incompatible with 


I want to add an Image Captioning model to Fabrik. It seems pretty easy, all you have to do is find a JSON format of the model you want, and there you go! All done. But in reality, it wasn't that easy.

First, I have to find an image captioning mode. My first choice landed to NeuralTalk since it's pretty popular. After heading to the GitHub page, it seems like NeuralTalk is obsoleted by NeuralTalk2, so I take NeuralTalk2 After having a hard time trying to install it and trying to make the JSON file, I realized something. NeuralTalk2 use torch as its framework and Fabrik doesn't support torch. Fabrik only supports Caffe, Keras, and Tensorflow. (I never made the JSON file by the way)

I have to try another model. I ended up trying Neural Image Captioning by oarriaga on github. Unlike NeuralTalk2, making the JSON file was pretty smooth. 
So I try to find another model. Show and Tell looks good. It uses Tensorflow as its framework, but unfortunately Fabrik <><><>< so I have to find another model

2 comments:

  1. 188bet Casino – Free Bets, No Deposit Bonuses, Cashbacks
    188bet is a casino that was established in 11bet 2015. It was launched in 2017 and has since 188bet grown to become a reliable site dafabet for players to bet. The site

    ReplyDelete
  2. Use the bonus code “WILD250” for the 250% 1st deposit bonus up to as} 카지노사이트 $1,000, and the one “WILD100” for the subsequent four match bonuses. However, yow will discover wager-free casino bonuses albeit hardly ever. These are principally free funds for you, that means that you simply get cash immediately. No need to play, could get} your money and cash it out immediately.

    ReplyDelete

Simple Image Classification with Keras

Keras logo There are several kind of image classification: Binary classification Multiclass classification Multi label classificat...