The Shiba is the smallest of the Japanese native breeds, which include the Kai Inu, Hokkaido Inu, Kishu Inu, Shikoku Inu, Tosa Inu and the Akita Inu. Despite its smaller size it was bred to hunt small wild game, bear, boar and to flush birds. The name Shiba means, both "small" and "brushwood" in Japanese. It may have been named after the terrain the dogs hunted in or the color of the Shiba's coat, or perhaps the dog's size. The word "Inu" means "dog." As with many breeds, the second world war nearly did the breed in. After the war was over, several breeding programs worked to bring the breed back to safe numbers.
The breed was first imported into the United States in 1954, although no serious importation for breeding or showing was done until the late 1970s. The first litter was born in 1979. The American Kennel Club recognized the breed in 1993. The Shiba ranks 63rd among the breeds registered by AKC.