Julen Etxaniz
PhD Student in Language Analysis and Processing
University of the Basque Country (UPV/EHU)
Faculty of Informatics
PhD Student in Language Analysis and Processing at the Faculty of Informatics of the University of the Basque Country (UPV/EHU). Graduate in Computer Engineering with speciality in Software Engineering. Master in Language Analysis and Processing.
In this web you will find information about Skills, Certificates, Projects, Tags and Contact.
Experience
Certificates
Languages
Programming Languages
Web Development
Software Engineering
Machine Learning
Tools
Humans can learn to understand and process the distribution of space, and one of the initial tasks of Artificial Intelligence has been to show machines the relationships between space and the objects that appear in it. Humans naturally combine vision and textual information to acquire compositional and spatial relationships among objects, and when reading a text, we are able to mentally depict the spatial relationships that may appear in it. Thus, the visual differences between images depicting “a person sits and a dog stands” and “a person stands and a dog sits” are obvious for humans, but still not clear for automatic systems. In this project, we propose to evaluate grounded Neural Language models that can perform compositional and spatial reasoning. Neural Language models (LM) have shown impressive capabilities on many NLP tasks but, despite their success, they have been criticized for their lack of meaning. Vision-and-Language models (VLM), trained jointly on text and image data, have been offered as a response to such criticisms, but recent work has shown that these models struggle to ground spatial concepts properly. In the project, we evaluate state-of-the-art pre-trained and fine-tuned VLMs to understand their grounding level on compositional and spatial reasoning. We also propose a variety of methods to create synthetic datasets specially focused on compositional reasoning. We managed to accomplish all the objectives of this work. First, we improved the state-of-the-art in compositional reasoning. Next, we performed some zero-shot experiments on spatial reasoning. Finally, we explored three alternatives for synthetic dataset creation: text-to-image generation, image captioning and image retrieval. Code is released at https://github.com/juletx/spatial-reasoning and models are released at https://huggingface.co/juletxara.
Projects
Image Caption Generation
Automatic Image Caption Generation model that uses a CNN to condition a LSTM based language model.
Shape Classification
The goal of the project is to compare different classification algorithms on the solution of plane and car shape datasets.
Academic Website
Academic personal website that includes a short description, social links, biography, interests, education, skills, experience, accomplishments, projects and contact info.
Antxieta Arkeologi Taldea Website
Antxieta Arkeologi Taldea website, a non-profit cultural group that develops archaeological research in Gipuzkoa.
Community Detection
NIPS kongresuko autoreen komunitateak detektatzen metaheuristikoak erabiliz.
Comparing Writing Systems
Comparing Writing Systems with Multilingual Grapheme-to-Phoneme and Phoneme-to-Grapheme Conversion.
Deep Learning for Natural Language Processing
Deep Learning for Natural Language Processing slides, labs and assignments.
Egunean Behin Visual Question Answering Dataset
This is a Visual Question Answering dataset based on questions from the game Egunean Behin. Egunean Behin is a popular Basque quiz game. The game consists on answering 10 daily multiple choice questions.
GitHub Website
GitHub personal website that includes a photo, short description, social links and GitHub repositories and topics.
Grounding Language Models for Spatial Reasoning
Grounding Language Models for Spatial Reasoning
Hyperpartisan News Analysis With Scattertext
Hyperpartisan News Analysis With Scattertext
Mejorando la seguridad de mi web
Analizaré mi web con herramientas como Hardenize y Security Headers para detectar los aspectos de seguridad que se pueden mejorar.
NLP Applications I - Text Classification, Sequence Labelling, Opinion Mining and Question Answering
NLP Applications I - Text Classification, Sequence Labelling, Opinion Mining and Question Answering slides, labs and project.
NLP Applications II - Information Extraction, Question Answering, Recommender Systems and Conversational Systems
NLP Applications II - Information Extraction, Question Answering, Recommender Systems and Conversational Systems slides, labs and project.
Spiking Neural Network
Simulating the Izhikevich spiking neuron model using the Brian2 software
Zero-shot and Translation Experiments on XQuAD, MLQA and TyDiQA
Zero-shot and Translation Experiments on XQuAD, MLQA and TyDiQA
Contact
- juletxara@gmail.com
- github.com/juletx
- linkedin.com/in/juletxara
- twitter.com/juletxara
- instagram.com/juletxara
- hackerrank.com/juletxara
- kaggle.com/juletxara
-
Faculty of Informatics
Manuel Lardizabal Ibilbidea, 1
Donostia, Gipuzkoa 20018, Spain