# Opinion Classification with Kili and HuggingFace AutoTrain

huggingface.co · Alper · Apr 28, 2022

**Type:** Tutorial

## Summary

Understanding mobile application user feedback often requires expensive and labor-intensive manual analysis. To streamline this process, an active learning pipeline was constructed using Kili for data annotation alongside HuggingFace AutoTrain and standard transformers for text classification. The workflow utilized approximately 40,000 Medium reviews collected from the Google Play Store, classifying content into categories such as Subscription, Content, Interface, and User Experience. Hyperparameter searches with Ray backend were compared against AutoTrain, which automated training within 30 minutes. Subsequent sentiment analysis of the categorized reviews revealed that while overall sentiment remained positive, subscription and interface categories contained predominantly negative feedback, especially in application version 4.5.

## Context

Extracting insights from large volumes of user feedback manually is expensive and labor-intensive for user-facing applications.

## Approach / What changed

Using Kili's collaborative annotation platform and Python API, the author labeled Google Play Store reviews for Medium across defined categories, then trained classification models using HuggingFace AutoTrain and standard HuggingFace transformers with Ray hyperparameter optimization before applying sentiment analysis.

## Takeaways

- Kili provides APIs and web interfaces to set up multi-class text classification and named entity recognition labeling jobs.
- AutoTrain automated data cleaning, model selection, and hyperparameter optimization, completing model training in 30 minutes.
- Categorized sentiment analysis revealed that most negative reviews concentrated specifically around subscription features and interface issues.

**Tags:** [Data Pipelines](https://yomu.fyi/topic/data-pipelines), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Python](https://yomu.fyi/topic/python)

[Read original post](https://huggingface.co/blog/opinion-classification-with-kili)