InfoWorld

Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and ...
IEEE

Simple Self-Distillation Learning for Noisy Image Classification

Abstract: In computer vision, considerable success has been achieved in image classification. Yet, real-world applications can be negatively affected by noise corruption, so a method for dealing with ...
GitHub

Apicurio Registry Example Applications

This repository contains a set of example applications (mostly Kafka applications) that use the Apicurio Registry as part of their workflow. The registry is typically used to store schemas used by ...
GitHub

bit.io simple pipeline

This repo is intended to provide a simple pipeline example for getting started with programmtic data ingestion and updates in bit.io. To keep the repo simple, many best practices such as logging, ...
IEEE

FractalAD: A simple industrial anomaly detection method using fractal anomaly generation and backbone knowledge distillation

Abstract: While industrial anomaly detection (AD) technology has experienced notable advancements in recent years, the challenges of generating realistic anomalies and acquiring a deep understanding ...