Upload VMambaForImageClassification

README.md

@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]

config.json

@@ -0,0 +1,2035 @@
+{
+  "architectures": [
+    "VMambaForImageClassification"
+  ],
+  "auto_map": {
+    "AutoConfig": "configuration_vmamba.VMambaConfig",
+    "AutoModelForImageClassification": "modeling_vmamba.VMambaForImageClassification"
+  },
+  "depths": [
+    2,
+    2,
+    20,
+    2
+  ],
+  "dims": [
+    96,
+    192,
+    384,
+    768
+  ],
+  "drop_path_rate": 0.2,
+  "embed_dim": 96,
+  "id2label": {
+    "0": "tench, Tinca tinca",
+    "1": "goldfish, Carassius auratus",
+    "2": "great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias",
+    "3": "tiger shark, Galeocerdo cuvieri",
+    "4": "hammerhead, hammerhead shark",
+    "5": "electric ray, crampfish, numbfish, torpedo",
+    "6": "stingray",
+    "7": "cock",
+    "8": "hen",
+    "9": "ostrich, Struthio camelus",
+    "10": "brambling, Fringilla montifringilla",
+    "11": "goldfinch, Carduelis carduelis",
+    "12": "house finch, linnet, Carpodacus mexicanus",
+    "13": "junco, snowbird",
+    "14": "indigo bunting, indigo finch, indigo bird, Passerina cyanea",
+    "15": "robin, American robin, Turdus migratorius",
+    "16": "bulbul",
+    "17": "jay",
+    "18": "magpie",
+    "19": "chickadee",
+    "20": "water ouzel, dipper",
+    "21": "kite",
+    "22": "bald eagle, American eagle, Haliaeetus leucocephalus",
+    "23": "vulture",
+    "24": "great grey owl, great gray owl, Strix nebulosa",
+    "25": "European fire salamander, Salamandra salamandra",
+    "26": "common newt, Triturus vulgaris",
+    "27": "eft",
+    "28": "spotted salamander, Ambystoma maculatum",
+    "29": "axolotl, mud puppy, Ambystoma mexicanum",
+    "30": "bullfrog, Rana catesbeiana",
+    "31": "tree frog, tree-frog",
+    "32": "tailed frog, bell toad, ribbed toad, tailed toad, Ascaphus trui",
+    "33": "loggerhead, loggerhead turtle, Caretta caretta",
+    "34": "leatherback turtle, leatherback, leathery turtle, Dermochelys coriacea",
+    "35": "mud turtle",
+    "36": "terrapin",
+    "37": "box turtle, box tortoise",
+    "38": "banded gecko",
+    "39": "common iguana, iguana, Iguana iguana",
+    "40": "American chameleon, anole, Anolis carolinensis",
+    "41": "whiptail, whiptail lizard",
+    "42": "agama",
+    "43": "frilled lizard, Chlamydosaurus kingi",
+    "44": "alligator lizard",
+    "45": "Gila monster, Heloderma suspectum",
+    "46": "green lizard, Lacerta viridis",
+    "47": "African chameleon, Chamaeleo chamaeleon",
+    "48": "Komodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensis",
+    "49": "African crocodile, Nile crocodile, Crocodylus niloticus",
+    "50": "American alligator, Alligator mississipiensis",
+    "51": "triceratops",
+    "52": "thunder snake, worm snake, Carphophis amoenus",
+    "53": "ringneck snake, ring-necked snake, ring snake",
+    "54": "hognose snake, puff adder, sand viper",
+    "55": "green snake, grass snake",
+    "56": "king snake, kingsnake",
+    "57": "garter snake, grass snake",
+    "58": "water snake",
+    "59": "vine snake",
+    "60": "night snake, Hypsiglena torquata",
+    "61": "boa constrictor, Constrictor constrictor",
+    "62": "rock python, rock snake, Python sebae",
+    "63": "Indian cobra, Naja naja",
+    "64": "green mamba",
+    "65": "sea snake",
+    "66": "horned viper, cerastes, sand viper, horned asp, Cerastes cornutus",
+    "67": "diamondback, diamondback rattlesnake, Crotalus adamanteus",
+    "68": "sidewinder, horned rattlesnake, Crotalus cerastes",
+    "69": "trilobite",
+    "70": "harvestman, daddy longlegs, Phalangium opilio",
+    "71": "scorpion",
+    "72": "black and gold garden spider, Argiope aurantia",
+    "73": "barn spider, Araneus cavaticus",
+    "74": "garden spider, Aranea diademata",
+    "75": "black widow, Latrodectus mactans",
+    "76": "tarantula",
+    "77": "wolf spider, hunting spider",
+    "78": "tick",
+    "79": "centipede",
+    "80": "black grouse",
+    "81": "ptarmigan",
+    "82": "ruffed grouse, partridge, Bonasa umbellus",
+    "83": "prairie chicken, prairie grouse, prairie fowl",
+    "84": "peacock",
+    "85": "quail",
+    "86": "partridge",
+    "87": "African grey, African gray, Psittacus erithacus",
+    "88": "macaw",
+    "89": "sulphur-crested cockatoo, Kakatoe galerita, Cacatua galerita",
+    "90": "lorikeet",
+    "91": "coucal",
+    "92": "bee eater",
+    "93": "hornbill",
+    "94": "hummingbird",
+    "95": "jacamar",
+    "96": "toucan",
+    "97": "drake",
+    "98": "red-breasted merganser, Mergus serrator",
+    "99": "goose",
+    "100": "black swan, Cygnus atratus",
+    "101": "tusker",
+    "102": "echidna, spiny anteater, anteater",
+    "103": "platypus, duckbill, duckbilled platypus, duck-billed platypus, Ornithorhynchus anatinus",
+    "104": "wallaby, brush kangaroo",
+    "105": "koala, koala bear, kangaroo bear, native bear, Phascolarctos cinereus",
+    "106": "wombat",
+    "107": "jellyfish",
+    "108": "sea anemone, anemone",
+    "109": "brain coral",
+    "110": "flatworm, platyhelminth",
+    "111": "nematode, nematode worm, roundworm",
+    "112": "conch",
+    "113": "snail",
+    "114": "slug",
+    "115": "sea slug, nudibranch",
+    "116": "chiton, coat-of-mail shell, sea cradle, polyplacophore",
+    "117": "chambered nautilus, pearly nautilus, nautilus",
+    "118": "Dungeness crab, Cancer magister",
+    "119": "rock crab, Cancer irroratus",
+    "120": "fiddler crab",
+    "121": "king crab, Alaska crab, Alaskan king crab, Alaska king crab, Paralithodes camtschatica",
+    "122": "American lobster, Northern lobster, Maine lobster, Homarus americanus",
+    "123": "spiny lobster, langouste, rock lobster, crawfish, crayfish, sea crawfish",
+    "124": "crayfish, crawfish, crawdad, crawdaddy",
+    "125": "hermit crab",
+    "126": "isopod",
+    "127": "white stork, Ciconia ciconia",
+    "128": "black stork, Ciconia nigra",
+    "129": "spoonbill",
+    "130": "flamingo",
+    "131": "little blue heron, Egretta caerulea",
+    "132": "American egret, great white heron, Egretta albus",
+    "133": "bittern",
+    "134": "crane",
+    "135": "limpkin, Aramus pictus",
+    "136": "European gallinule, Porphyrio porphyrio",
+    "137": "American coot, marsh hen, mud hen, water hen, Fulica americana",
+    "138": "bustard",
+    "139": "ruddy turnstone, Arenaria interpres",
+    "140": "red-backed sandpiper, dunlin, Erolia alpina",
+    "141": "redshank, Tringa totanus",
+    "142": "dowitcher",
+    "143": "oystercatcher, oyster catcher",
+    "144": "pelican",
+    "145": "king penguin, Aptenodytes patagonica",
+    "146": "albatross, mollymawk",
+    "147": "grey whale, gray whale, devilfish, Eschrichtius gibbosus, Eschrichtius robustus",
+    "148": "killer whale, killer, orca, grampus, sea wolf, Orcinus orca",
+    "149": "dugong, Dugong dugon",
+    "150": "sea lion",
+    "151": "Chihuahua",
+    "152": "Japanese spaniel",
+    "153": "Maltese dog, Maltese terrier, Maltese",
+    "154": "Pekinese, Pekingese, Peke",
+    "155": "Shih-Tzu",
+    "156": "Blenheim spaniel",
+    "157": "papillon",
+    "158": "toy terrier",
+    "159": "Rhodesian ridgeback",
+    "160": "Afghan hound, Afghan",
+    "161": "basset, basset hound",
+    "162": "beagle",
+    "163": "bloodhound, sleuthhound",
+    "164": "bluetick",
+    "165": "black-and-tan coonhound",
+    "166": "Walker hound, Walker foxhound",
+    "167": "English foxhound",
+    "168": "redbone",
+    "169": "borzoi, Russian wolfhound",
+    "170": "Irish wolfhound",
+    "171": "Italian greyhound",
+    "172": "whippet",
+    "173": "Ibizan hound, Ibizan Podenco",
+    "174": "Norwegian elkhound, elkhound",
+    "175": "otterhound, otter hound",
+    "176": "Saluki, gazelle hound",
+    "177": "Scottish deerhound, deerhound",
+    "178": "Weimaraner",
+    "179": "Staffordshire bullterrier, Staffordshire bull terrier",
+    "180": "American Staffordshire terrier, Staffordshire terrier, American pit bull terrier, pit bull terrier",
+    "181": "Bedlington terrier",
+    "182": "Border terrier",
+    "183": "Kerry blue terrier",
+    "184": "Irish terrier",
+    "185": "Norfolk terrier",
+    "186": "Norwich terrier",
+    "187": "Yorkshire terrier",
+    "188": "wire-haired fox terrier",
+    "189": "Lakeland terrier",
+    "190": "Sealyham terrier, Sealyham",
+    "191": "Airedale, Airedale terrier",
+    "192": "cairn, cairn terrier",
+    "193": "Australian terrier",
+    "194": "Dandie Dinmont, Dandie Dinmont terrier",
+    "195": "Boston bull, Boston terrier",
+    "196": "miniature schnauzer",
+    "197": "giant schnauzer",
+    "198": "standard schnauzer",
+    "199": "Scotch terrier, Scottish terrier, Scottie",
+    "200": "Tibetan terrier, chrysanthemum dog",
+    "201": "silky terrier, Sydney silky",
+    "202": "soft-coated wheaten terrier",
+    "203": "West Highland white terrier",
+    "204": "Lhasa, Lhasa apso",
+    "205": "flat-coated retriever",
+    "206": "curly-coated retriever",
+    "207": "golden retriever",
+    "208": "Labrador retriever",
+    "209": "Chesapeake Bay retriever",
+    "210": "German short-haired pointer",
+    "211": "vizsla, Hungarian pointer",
+    "212": "English setter",
+    "213": "Irish setter, red setter",
+    "214": "Gordon setter",
+    "215": "Brittany spaniel",
+    "216": "clumber, clumber spaniel",
+    "217": "English springer, English springer spaniel",
+    "218": "Welsh springer spaniel",
+    "219": "cocker spaniel, English cocker spaniel, cocker",
+    "220": "Sussex spaniel",
+    "221": "Irish water spaniel",
+    "222": "kuvasz",
+    "223": "schipperke",
+    "224": "groenendael",
+    "225": "malinois",
+    "226": "briard",
+    "227": "kelpie",
+    "228": "komondor",
+    "229": "Old English sheepdog, bobtail",
+    "230": "Shetland sheepdog, Shetland sheep dog, Shetland",
+    "231": "collie",
+    "232": "Border collie",
+    "233": "Bouvier des Flandres, Bouviers des Flandres",
+    "234": "Rottweiler",
+    "235": "German shepherd, German shepherd dog, German police dog, alsatian",
+    "236": "Doberman, Doberman pinscher",
+    "237": "miniature pinscher",
+    "238": "Greater Swiss Mountain dog",
+    "239": "Bernese mountain dog",
+    "240": "Appenzeller",
+    "241": "EntleBucher",
+    "242": "boxer",
+    "243": "bull mastiff",
+    "244": "Tibetan mastiff",
+    "245": "French bulldog",
+    "246": "Great Dane",
+    "247": "Saint Bernard, St Bernard",
+    "248": "Eskimo dog, husky",
+    "249": "malamute, malemute, Alaskan malamute",
+    "250": "Siberian husky",
+    "251": "dalmatian, coach dog, carriage dog",
+    "252": "affenpinscher, monkey pinscher, monkey dog",
+    "253": "basenji",
+    "254": "pug, pug-dog",
+    "255": "Leonberg",
+    "256": "Newfoundland, Newfoundland dog",
+    "257": "Great Pyrenees",
+    "258": "Samoyed, Samoyede",
+    "259": "Pomeranian",
+    "260": "chow, chow chow",
+    "261": "keeshond",
+    "262": "Brabancon griffon",
+    "263": "Pembroke, Pembroke Welsh corgi",
+    "264": "Cardigan, Cardigan Welsh corgi",
+    "265": "toy poodle",
+    "266": "miniature poodle",
+    "267": "standard poodle",
+    "268": "Mexican hairless",
+    "269": "timber wolf, grey wolf, gray wolf, Canis lupus",
+    "270": "white wolf, Arctic wolf, Canis lupus tundrarum",
+    "271": "red wolf, maned wolf, Canis rufus, Canis niger",
+    "272": "coyote, prairie wolf, brush wolf, Canis latrans",
+    "273": "dingo, warrigal, warragal, Canis dingo",
+    "274": "dhole, Cuon alpinus",
+    "275": "African hunting dog, hyena dog, Cape hunting dog, Lycaon pictus",
+    "276": "hyena, hyaena",
+    "277": "red fox, Vulpes vulpes",
+    "278": "kit fox, Vulpes macrotis",
+    "279": "Arctic fox, white fox, Alopex lagopus",
+    "280": "grey fox, gray fox, Urocyon cinereoargenteus",
+    "281": "tabby, tabby cat",
+    "282": "tiger cat",
+    "283": "Persian cat",
+    "284": "Siamese cat, Siamese",
+    "285": "Egyptian cat",
+    "286": "cougar, puma, catamount, mountain lion, painter, panther, Felis concolor",
+    "287": "lynx, catamount",
+    "288": "leopard, Panthera pardus",
+    "289": "snow leopard, ounce, Panthera uncia",
+    "290": "jaguar, panther, Panthera onca, Felis onca",
+    "291": "lion, king of beasts, Panthera leo",
+    "292": "tiger, Panthera tigris",
+    "293": "cheetah, chetah, Acinonyx jubatus",
+    "294": "brown bear, bruin, Ursus arctos",
+    "295": "American black bear, black bear, Ursus americanus, Euarctos americanus",
+    "296": "ice bear, polar bear, Ursus Maritimus, Thalarctos maritimus",
+    "297": "sloth bear, Melursus ursinus, Ursus ursinus",
+    "298": "mongoose",
+    "299": "meerkat, mierkat",
+    "300": "tiger beetle",
+    "301": "ladybug, ladybeetle, lady beetle, ladybird, ladybird beetle",
+    "302": "ground beetle, carabid beetle",
+    "303": "long-horned beetle, longicorn, longicorn beetle",
+    "304": "leaf beetle, chrysomelid",
+    "305": "dung beetle",
+    "306": "rhinoceros beetle",
+    "307": "weevil",
+    "308": "fly",
+    "309": "bee",
+    "310": "ant, emmet, pismire",
+    "311": "grasshopper, hopper",
+    "312": "cricket",
+    "313": "walking stick, walkingstick, stick insect",
+    "314": "cockroach, roach",
+    "315": "mantis, mantid",
+    "316": "cicada, cicala",
+    "317": "leafhopper",
+    "318": "lacewing, lacewing fly",
+    "319": "dragonfly, darning needle, devil's darning needle, sewing needle, snake feeder, snake doctor, mosquito hawk, skeeter hawk",
+    "320": "damselfly",
+    "321": "admiral",
+    "322": "ringlet, ringlet butterfly",
+    "323": "monarch, monarch butterfly, milkweed butterfly, Danaus plexippus",
+    "324": "cabbage butterfly",
+    "325": "sulphur butterfly, sulfur butterfly",
+    "326": "lycaenid, lycaenid butterfly",
+    "327": "starfish, sea star",
+    "328": "sea urchin",
+    "329": "sea cucumber, holothurian",
+    "330": "wood rabbit, cottontail, cottontail rabbit",
+    "331": "hare",
+    "332": "Angora, Angora rabbit",
+    "333": "hamster",
+    "334": "porcupine, hedgehog",
+    "335": "fox squirrel, eastern fox squirrel, Sciurus niger",
+    "336": "marmot",
+    "337": "beaver",
+    "338": "guinea pig, Cavia cobaya",
+    "339": "sorrel",
+    "340": "zebra",
+    "341": "hog, pig, grunter, squealer, Sus scrofa",
+    "342": "wild boar, boar, Sus scrofa",
+    "343": "warthog",
+    "344": "hippopotamus, hippo, river horse, Hippopotamus amphibius",
+    "345": "ox",
+    "346": "water buffalo, water ox, Asiatic buffalo, Bubalus bubalis",
+    "347": "bison",
+    "348": "ram, tup",
+    "349": "bighorn, bighorn sheep, cimarron, Rocky Mountain bighorn, Rocky Mountain sheep, Ovis canadensis",
+    "350": "ibex, Capra ibex",
+    "351": "hartebeest",
+    "352": "impala, Aepyceros melampus",
+    "353": "gazelle",
+    "354": "Arabian camel, dromedary, Camelus dromedarius",
+    "355": "llama",
+    "356": "weasel",
+    "357": "mink",
+    "358": "polecat, fitch, foulmart, foumart, Mustela putorius",
+    "359": "black-footed ferret, ferret, Mustela nigripes",
+    "360": "otter",
+    "361": "skunk, polecat, wood pussy",
+    "362": "badger",
+    "363": "armadillo",
+    "364": "three-toed sloth, ai, Bradypus tridactylus",
+    "365": "orangutan, orang, orangutang, Pongo pygmaeus",
+    "366": "gorilla, Gorilla gorilla",
+    "367": "chimpanzee, chimp, Pan troglodytes",
+    "368": "gibbon, Hylobates lar",
+    "369": "siamang, Hylobates syndactylus, Symphalangus syndactylus",
+    "370": "guenon, guenon monkey",
+    "371": "patas, hussar monkey, Erythrocebus patas",
+    "372": "baboon",
+    "373": "macaque",
+    "374": "langur",
+    "375": "colobus, colobus monkey",
+    "376": "proboscis monkey, Nasalis larvatus",
+    "377": "marmoset",
+    "378": "capuchin, ringtail, Cebus capucinus",
+    "379": "howler monkey, howler",
+    "380": "titi, titi monkey",
+    "381": "spider monkey, Ateles geoffroyi",
+    "382": "squirrel monkey, Saimiri sciureus",
+    "383": "Madagascar cat, ring-tailed lemur, Lemur catta",
+    "384": "indri, indris, Indri indri, Indri brevicaudatus",
+    "385": "Indian elephant, Elephas maximus",
+    "386": "African elephant, Loxodonta africana",
+    "387": "lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens",
+    "388": "giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca",
+    "389": "barracouta, snoek",
+    "390": "eel",
+    "391": "coho, cohoe, coho salmon, blue jack, silver salmon, Oncorhynchus kisutch",
+    "392": "rock beauty, Holocanthus tricolor",
+    "393": "anemone fish",
+    "394": "sturgeon",
+    "395": "gar, garfish, garpike, billfish, Lepisosteus osseus",
+    "396": "lionfish",
+    "397": "puffer, pufferfish, blowfish, globefish",
+    "398": "abacus",
+    "399": "abaya",
+    "400": "academic gown, academic robe, judge's robe",
+    "401": "accordion, piano accordion, squeeze box",
+    "402": "acoustic guitar",
+    "403": "aircraft carrier, carrier, flattop, attack aircraft carrier",
+    "404": "airliner",
+    "405": "airship, dirigible",
+    "406": "altar",
+    "407": "ambulance",
+    "408": "amphibian, amphibious vehicle",
+    "409": "analog clock",
+    "410": "apiary, bee house",
+    "411": "apron",
+    "412": "ashcan, trash can, garbage can, wastebin, ash bin, ash-bin, ashbin, dustbin, trash barrel, trash bin",
+    "413": "assault rifle, assault gun",
+    "414": "backpack, back pack, knapsack, packsack, rucksack, haversack",
+    "415": "bakery, bakeshop, bakehouse",
+    "416": "balance beam, beam",
+    "417": "balloon",
+    "418": "ballpoint, ballpoint pen, ballpen, Biro",
+    "419": "Band Aid",
+    "420": "banjo",
+    "421": "bannister, banister, balustrade, balusters, handrail",
+    "422": "barbell",
+    "423": "barber chair",
+    "424": "barbershop",
+    "425": "barn",
+    "426": "barometer",
+    "427": "barrel, cask",
+    "428": "barrow, garden cart, lawn cart, wheelbarrow",
+    "429": "baseball",
+    "430": "basketball",
+    "431": "bassinet",
+    "432": "bassoon",
+    "433": "bathing cap, swimming cap",
+    "434": "bath towel",
+    "435": "bathtub, bathing tub, bath, tub",
+    "436": "beach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggon",
+    "437": "beacon, lighthouse, beacon light, pharos",
+    "438": "beaker",
+    "439": "bearskin, busby, shako",
+    "440": "beer bottle",
+    "441": "beer glass",
+    "442": "bell cote, bell cot",
+    "443": "bib",
+    "444": "bicycle-built-for-two, tandem bicycle, tandem",
+    "445": "bikini, two-piece",
+    "446": "binder, ring-binder",
+    "447": "binoculars, field glasses, opera glasses",
+    "448": "birdhouse",
+    "449": "boathouse",
+    "450": "bobsled, bobsleigh, bob",
+    "451": "bolo tie, bolo, bola tie, bola",
+    "452": "bonnet, poke bonnet",
+    "453": "bookcase",
+    "454": "bookshop, bookstore, bookstall",
+    "455": "bottlecap",
+    "456": "bow",
+    "457": "bow tie, bow-tie, bowtie",
+    "458": "brass, memorial tablet, plaque",
+    "459": "brassiere, bra, bandeau",
+    "460": "breakwater, groin, groyne, mole, bulwark, seawall, jetty",
+    "461": "breastplate, aegis, egis",
+    "462": "broom",
+    "463": "bucket, pail",
+    "464": "buckle",
+    "465": "bulletproof vest",
+    "466": "bullet train, bullet",
+    "467": "butcher shop, meat market",
+    "468": "cab, hack, taxi, taxicab",
+    "469": "caldron, cauldron",
+    "470": "candle, taper, wax light",
+    "471": "cannon",
+    "472": "canoe",
+    "473": "can opener, tin opener",
+    "474": "cardigan",
+    "475": "car mirror",
+    "476": "carousel, carrousel, merry-go-round, roundabout, whirligig",
+    "477": "carpenter's kit, tool kit",
+    "478": "carton",
+    "479": "car wheel",
+    "480": "cash machine, cash dispenser, automated teller machine, automatic teller machine, automated teller, automatic teller, ATM",
+    "481": "cassette",
+    "482": "cassette player",
+    "483": "castle",
+    "484": "catamaran",
+    "485": "CD player",
+    "486": "cello, violoncello",
+    "487": "cellular telephone, cellular phone, cellphone, cell, mobile phone",
+    "488": "chain",
+    "489": "chainlink fence",
+    "490": "chain mail, ring mail, mail, chain armor, chain armour, ring armor, ring armour",
+    "491": "chain saw, chainsaw",
+    "492": "chest",
+    "493": "chiffonier, commode",
+    "494": "chime, bell, gong",
+    "495": "china cabinet, china closet",
+    "496": "Christmas stocking",
+    "497": "church, church building",
+    "498": "cinema, movie theater, movie theatre, movie house, picture palace",
+    "499": "cleaver, meat cleaver, chopper",
+    "500": "cliff dwelling",
+    "501": "cloak",
+    "502": "clog, geta, patten, sabot",
+    "503": "cocktail shaker",
+    "504": "coffee mug",
+    "505": "coffeepot",
+    "506": "coil, spiral, volute, whorl, helix",
+    "507": "combination lock",
+    "508": "computer keyboard, keypad",
+    "509": "confectionery, confectionary, candy store",
+    "510": "container ship, containership, container vessel",
+    "511": "convertible",
+    "512": "corkscrew, bottle screw",
+    "513": "cornet, horn, trumpet, trump",
+    "514": "cowboy boot",
+    "515": "cowboy hat, ten-gallon hat",
+    "516": "cradle",
+    "517": "crane",
+    "518": "crash helmet",
+    "519": "crate",
+    "520": "crib, cot",
+    "521": "Crock Pot",
+    "522": "croquet ball",
+    "523": "crutch",
+    "524": "cuirass",
+    "525": "dam, dike, dyke",
+    "526": "desk",
+    "527": "desktop computer",
+    "528": "dial telephone, dial phone",
+    "529": "diaper, nappy, napkin",
+    "530": "digital clock",
+    "531": "digital watch",
+    "532": "dining table, board",
+    "533": "dishrag, dishcloth",
+    "534": "dishwasher, dish washer, dishwashing machine",
+    "535": "disk brake, disc brake",
+    "536": "dock, dockage, docking facility",
+    "537": "dogsled, dog sled, dog sleigh",
+    "538": "dome",
+    "539": "doormat, welcome mat",
+    "540": "drilling platform, offshore rig",
+    "541": "drum, membranophone, tympan",
+    "542": "drumstick",
+    "543": "dumbbell",
+    "544": "Dutch oven",
+    "545": "electric fan, blower",
+    "546": "electric guitar",
+    "547": "electric locomotive",
+    "548": "entertainment center",
+    "549": "envelope",
+    "550": "espresso maker",
+    "551": "face powder",
+    "552": "feather boa, boa",
+    "553": "file, file cabinet, filing cabinet",
+    "554": "fireboat",
+    "555": "fire engine, fire truck",
+    "556": "fire screen, fireguard",
+    "557": "flagpole, flagstaff",
+    "558": "flute, transverse flute",
+    "559": "folding chair",
+    "560": "football helmet",
+    "561": "forklift",
+    "562": "fountain",
+    "563": "fountain pen",
+    "564": "four-poster",
+    "565": "freight car",
+    "566": "French horn, horn",
+    "567": "frying pan, frypan, skillet",
+    "568": "fur coat",
+    "569": "garbage truck, dustcart",
+    "570": "gasmask, respirator, gas helmet",
+    "571": "gas pump, gasoline pump, petrol pump, island dispenser",
+    "572": "goblet",
+    "573": "go-kart",
+    "574": "golf ball",
+    "575": "golfcart, golf cart",
+    "576": "gondola",
+    "577": "gong, tam-tam",
+    "578": "gown",
+    "579": "grand piano, grand",
+    "580": "greenhouse, nursery, glasshouse",
+    "581": "grille, radiator grille",
+    "582": "grocery store, grocery, food market, market",
+    "583": "guillotine",
+    "584": "hair slide",
+    "585": "hair spray",
+    "586": "half track",
+    "587": "hammer",
+    "588": "hamper",
+    "589": "hand blower, blow dryer, blow drier, hair dryer, hair drier",
+    "590": "hand-held computer, hand-held microcomputer",
+    "591": "handkerchief, hankie, hanky, hankey",
+    "592": "hard disc, hard disk, fixed disk",
+    "593": "harmonica, mouth organ, harp, mouth harp",
+    "594": "harp",
+    "595": "harvester, reaper",
+    "596": "hatchet",
+    "597": "holster",
+    "598": "home theater, home theatre",
+    "599": "honeycomb",
+    "600": "hook, claw",
+    "601": "hoopskirt, crinoline",
+    "602": "horizontal bar, high bar",
+    "603": "horse cart, horse-cart",
+    "604": "hourglass",
+    "605": "iPod",
+    "606": "iron, smoothing iron",
+    "607": "jack-o'-lantern",
+    "608": "jean, blue jean, denim",
+    "609": "jeep, landrover",
+    "610": "jersey, T-shirt, tee shirt",
+    "611": "jigsaw puzzle",
+    "612": "jinrikisha, ricksha, rickshaw",
+    "613": "joystick",
+    "614": "kimono",
+    "615": "knee pad",
+    "616": "knot",
+    "617": "lab coat, laboratory coat",
+    "618": "ladle",
+    "619": "lampshade, lamp shade",
+    "620": "laptop, laptop computer",
+    "621": "lawn mower, mower",
+    "622": "lens cap, lens cover",
+    "623": "letter opener, paper knife, paperknife",
+    "624": "library",
+    "625": "lifeboat",
+    "626": "lighter, light, igniter, ignitor",
+    "627": "limousine, limo",
+    "628": "liner, ocean liner",
+    "629": "lipstick, lip rouge",
+    "630": "Loafer",
+    "631": "lotion",
+    "632": "loudspeaker, speaker, speaker unit, loudspeaker system, speaker system",
+    "633": "loupe, jeweler's loupe",
+    "634": "lumbermill, sawmill",
+    "635": "magnetic compass",
+    "636": "mailbag, postbag",
+    "637": "mailbox, letter box",
+    "638": "maillot",
+    "639": "maillot, tank suit",
+    "640": "manhole cover",
+    "641": "maraca",
+    "642": "marimba, xylophone",
+    "643": "mask",
+    "644": "matchstick",
+    "645": "maypole",
+    "646": "maze, labyrinth",
+    "647": "measuring cup",
+    "648": "medicine chest, medicine cabinet",
+    "649": "megalith, megalithic structure",
+    "650": "microphone, mike",
+    "651": "microwave, microwave oven",
+    "652": "military uniform",
+    "653": "milk can",
+    "654": "minibus",
+    "655": "miniskirt, mini",
+    "656": "minivan",
+    "657": "missile",
+    "658": "mitten",
+    "659": "mixing bowl",
+    "660": "mobile home, manufactured home",
+    "661": "Model T",
+    "662": "modem",
+    "663": "monastery",
+    "664": "monitor",
+    "665": "moped",
+    "666": "mortar",
+    "667": "mortarboard",
+    "668": "mosque",
+    "669": "mosquito net",
+    "670": "motor scooter, scooter",
+    "671": "mountain bike, all-terrain bike, off-roader",
+    "672": "mountain tent",
+    "673": "mouse, computer mouse",
+    "674": "mousetrap",
+    "675": "moving van",
+    "676": "muzzle",
+    "677": "nail",
+    "678": "neck brace",
+    "679": "necklace",
+    "680": "nipple",
+    "681": "notebook, notebook computer",
+    "682": "obelisk",
+    "683": "oboe, hautboy, hautbois",
+    "684": "ocarina, sweet potato",
+    "685": "odometer, hodometer, mileometer, milometer",
+    "686": "oil filter",
+    "687": "organ, pipe organ",
+    "688": "oscilloscope, scope, cathode-ray oscilloscope, CRO",
+    "689": "overskirt",
+    "690": "oxcart",
+    "691": "oxygen mask",
+    "692": "packet",
+    "693": "paddle, boat paddle",
+    "694": "paddlewheel, paddle wheel",
+    "695": "padlock",
+    "696": "paintbrush",
+    "697": "pajama, pyjama, pj's, jammies",
+    "698": "palace",
+    "699": "panpipe, pandean pipe, syrinx",
+    "700": "paper towel",
+    "701": "parachute, chute",
+    "702": "parallel bars, bars",
+    "703": "park bench",
+    "704": "parking meter",
+    "705": "passenger car, coach, carriage",
+    "706": "patio, terrace",
+    "707": "pay-phone, pay-station",
+    "708": "pedestal, plinth, footstall",
+    "709": "pencil box, pencil case",
+    "710": "pencil sharpener",
+    "711": "perfume, essence",
+    "712": "Petri dish",
+    "713": "photocopier",
+    "714": "pick, plectrum, plectron",
+    "715": "pickelhaube",
+    "716": "picket fence, paling",
+    "717": "pickup, pickup truck",
+    "718": "pier",
+    "719": "piggy bank, penny bank",
+    "720": "pill bottle",
+    "721": "pillow",
+    "722": "ping-pong ball",
+    "723": "pinwheel",
+    "724": "pirate, pirate ship",
+    "725": "pitcher, ewer",
+    "726": "plane, carpenter's plane, woodworking plane",
+    "727": "planetarium",
+    "728": "plastic bag",
+    "729": "plate rack",
+    "730": "plow, plough",
+    "731": "plunger, plumber's helper",
+    "732": "Polaroid camera, Polaroid Land camera",
+    "733": "pole",
+    "734": "police van, police wagon, paddy wagon, patrol wagon, wagon, black Maria",
+    "735": "poncho",
+    "736": "pool table, billiard table, snooker table",
+    "737": "pop bottle, soda bottle",
+    "738": "pot, flowerpot",
+    "739": "potter's wheel",
+    "740": "power drill",
+    "741": "prayer rug, prayer mat",
+    "742": "printer",
+    "743": "prison, prison house",
+    "744": "projectile, missile",
+    "745": "projector",
+    "746": "puck, hockey puck",
+    "747": "punching bag, punch bag, punching ball, punchball",
+    "748": "purse",
+    "749": "quill, quill pen",
+    "750": "quilt, comforter, comfort, puff",
+    "751": "racer, race car, racing car",
+    "752": "racket, racquet",
+    "753": "radiator",
+    "754": "radio, wireless",
+    "755": "radio telescope, radio reflector",
+    "756": "rain barrel",
+    "757": "recreational vehicle, RV, R.V.",
+    "758": "reel",
+    "759": "reflex camera",
+    "760": "refrigerator, icebox",
+    "761": "remote control, remote",
+    "762": "restaurant, eating house, eating place, eatery",
+    "763": "revolver, six-gun, six-shooter",
+    "764": "rifle",
+    "765": "rocking chair, rocker",
+    "766": "rotisserie",
+    "767": "rubber eraser, rubber, pencil eraser",
+    "768": "rugby ball",
+    "769": "rule, ruler",
+    "770": "running shoe",
+    "771": "safe",
+    "772": "safety pin",
+    "773": "saltshaker, salt shaker",
+    "774": "sandal",
+    "775": "sarong",
+    "776": "sax, saxophone",
+    "777": "scabbard",
+    "778": "scale, weighing machine",
+    "779": "school bus",
+    "780": "schooner",
+    "781": "scoreboard",
+    "782": "screen, CRT screen",
+    "783": "screw",
+    "784": "screwdriver",
+    "785": "seat belt, seatbelt",
+    "786": "sewing machine",
+    "787": "shield, buckler",
+    "788": "shoe shop, shoe-shop, shoe store",
+    "789": "shoji",
+    "790": "shopping basket",
+    "791": "shopping cart",
+    "792": "shovel",
+    "793": "shower cap",
+    "794": "shower curtain",
+    "795": "ski",
+    "796": "ski mask",
+    "797": "sleeping bag",
+    "798": "slide rule, slipstick",
+    "799": "sliding door",
+    "800": "slot, one-armed bandit",
+    "801": "snorkel",
+    "802": "snowmobile",
+    "803": "snowplow, snowplough",
+    "804": "soap dispenser",
+    "805": "soccer ball",
+    "806": "sock",
+    "807": "solar dish, solar collector, solar furnace",
+    "808": "sombrero",
+    "809": "soup bowl",
+    "810": "space bar",
+    "811": "space heater",
+    "812": "space shuttle",
+    "813": "spatula",
+    "814": "speedboat",
+    "815": "spider web, spider's web",
+    "816": "spindle",
+    "817": "sports car, sport car",
+    "818": "spotlight, spot",
+    "819": "stage",
+    "820": "steam locomotive",
+    "821": "steel arch bridge",
+    "822": "steel drum",
+    "823": "stethoscope",
+    "824": "stole",
+    "825": "stone wall",
+    "826": "stopwatch, stop watch",
+    "827": "stove",
+    "828": "strainer",
+    "829": "streetcar, tram, tramcar, trolley, trolley car",
+    "830": "stretcher",
+    "831": "studio couch, day bed",
+    "832": "stupa, tope",
+    "833": "submarine, pigboat, sub, U-boat",
+    "834": "suit, suit of clothes",
+    "835": "sundial",
+    "836": "sunglass",
+    "837": "sunglasses, dark glasses, shades",
+    "838": "sunscreen, sunblock, sun blocker",
+    "839": "suspension bridge",
+    "840": "swab, swob, mop",
+    "841": "sweatshirt",
+    "842": "swimming trunks, bathing trunks",
+    "843": "swing",
+    "844": "switch, electric switch, electrical switch",
+    "845": "syringe",
+    "846": "table lamp",
+    "847": "tank, army tank, armored combat vehicle, armoured combat vehicle",
+    "848": "tape player",
+    "849": "teapot",
+    "850": "teddy, teddy bear",
+    "851": "television, television system",
+    "852": "tennis ball",
+    "853": "thatch, thatched roof",
+    "854": "theater curtain, theatre curtain",
+    "855": "thimble",
+    "856": "thresher, thrasher, threshing machine",
+    "857": "throne",
+    "858": "tile roof",
+    "859": "toaster",
+    "860": "tobacco shop, tobacconist shop, tobacconist",
+    "861": "toilet seat",
+    "862": "torch",
+    "863": "totem pole",
+    "864": "tow truck, tow car, wrecker",
+    "865": "toyshop",
+    "866": "tractor",
+    "867": "trailer truck, tractor trailer, trucking rig, rig, articulated lorry, semi",
+    "868": "tray",
+    "869": "trench coat",
+    "870": "tricycle, trike, velocipede",
+    "871": "trimaran",
+    "872": "tripod",
+    "873": "triumphal arch",
+    "874": "trolleybus, trolley coach, trackless trolley",
+    "875": "trombone",
+    "876": "tub, vat",
+    "877": "turnstile",
+    "878": "typewriter keyboard",
+    "879": "umbrella",
+    "880": "unicycle, monocycle",
+    "881": "upright, upright piano",
+    "882": "vacuum, vacuum cleaner",
+    "883": "vase",
+    "884": "vault",
+    "885": "velvet",
+    "886": "vending machine",
+    "887": "vestment",
+    "888": "viaduct",
+    "889": "violin, fiddle",
+    "890": "volleyball",
+    "891": "waffle iron",
+    "892": "wall clock",
+    "893": "wallet, billfold, notecase, pocketbook",
+    "894": "wardrobe, closet, press",
+    "895": "warplane, military plane",
+    "896": "washbasin, handbasin, washbowl, lavabo, wash-hand basin",
+    "897": "washer, automatic washer, washing machine",
+    "898": "water bottle",
+    "899": "water jug",
+    "900": "water tower",
+    "901": "whiskey jug",
+    "902": "whistle",
+    "903": "wig",
+    "904": "window screen",
+    "905": "window shade",
+    "906": "Windsor tie",
+    "907": "wine bottle",
+    "908": "wing",
+    "909": "wok",
+    "910": "wooden spoon",
+    "911": "wool, woolen, woollen",
+    "912": "worm fence, snake fence, snake-rail fence, Virginia fence",
+    "913": "wreck",
+    "914": "yawl",
+    "915": "yurt",
+    "916": "web site, website, internet site, site",
+    "917": "comic book",
+    "918": "crossword puzzle, crossword",
+    "919": "street sign",
+    "920": "traffic light, traffic signal, stoplight",
+    "921": "book jacket, dust cover, dust jacket, dust wrapper",
+    "922": "menu",
+    "923": "plate",
+    "924": "guacamole",
+    "925": "consomme",
+    "926": "hot pot, hotpot",
+    "927": "trifle",
+    "928": "ice cream, icecream",
+    "929": "ice lolly, lolly, lollipop, popsicle",
+    "930": "French loaf",
+    "931": "bagel, beigel",
+    "932": "pretzel",
+    "933": "cheeseburger",
+    "934": "hotdog, hot dog, red hot",
+    "935": "mashed potato",
+    "936": "head cabbage",
+    "937": "broccoli",
+    "938": "cauliflower",
+    "939": "zucchini, courgette",
+    "940": "spaghetti squash",
+    "941": "acorn squash",
+    "942": "butternut squash",
+    "943": "cucumber, cuke",
+    "944": "artichoke, globe artichoke",
+    "945": "bell pepper",
+    "946": "cardoon",
+    "947": "mushroom",
+    "948": "Granny Smith",
+    "949": "strawberry",
+    "950": "orange",
+    "951": "lemon",
+    "952": "fig",
+    "953": "pineapple, ananas",
+    "954": "banana",
+    "955": "jackfruit, jak, jack",
+    "956": "custard apple",
+    "957": "pomegranate",
+    "958": "hay",
+    "959": "carbonara",
+    "960": "chocolate sauce, chocolate syrup",
+    "961": "dough",
+    "962": "meat loaf, meatloaf",
+    "963": "pizza, pizza pie",
+    "964": "potpie",
+    "965": "burrito",
+    "966": "red wine",
+    "967": "espresso",
+    "968": "cup",
+    "969": "eggnog",
+    "970": "alp",
+    "971": "bubble",
+    "972": "cliff, drop, drop-off",
+    "973": "coral reef",
+    "974": "geyser",
+    "975": "lakeside, lakeshore",
+    "976": "promontory, headland, head, foreland",
+    "977": "sandbar, sand bar",
+    "978": "seashore, coast, seacoast, sea-coast",
+    "979": "valley, vale",
+    "980": "volcano",
+    "981": "ballplayer, baseball player",
+    "982": "groom, bridegroom",
+    "983": "scuba diver",
+    "984": "rapeseed",
+    "985": "daisy",
+    "986": "yellow lady's slipper, yellow lady-slipper, Cypripedium calceolus, Cypripedium parviflorum",
+    "987": "corn",
+    "988": "acorn",
+    "989": "hip, rose hip, rosehip",
+    "990": "buckeye, horse chestnut, conker",
+    "991": "coral fungus",
+    "992": "agaric",
+    "993": "gyromitra",
+    "994": "stinkhorn, carrion fungus",
+    "995": "earthstar",
+    "996": "hen-of-the-woods, hen of the woods, Polyporus frondosus, Grifola frondosa",
+    "997": "bolete",
+    "998": "ear, spike, capitulum",
+    "999": "toilet tissue, toilet paper, bathroom tissue"
+  },
+  "label2id": {
+    "Afghan hound, Afghan": 160,
+    "African chameleon, Chamaeleo chamaeleon": 47,
+    "African crocodile, Nile crocodile, Crocodylus niloticus": 49,
+    "African elephant, Loxodonta africana": 386,
+    "African grey, African gray, Psittacus erithacus": 87,
+    "African hunting dog, hyena dog, Cape hunting dog, Lycaon pictus": 275,
+    "Airedale, Airedale terrier": 191,
+    "American Staffordshire terrier, Staffordshire terrier, American pit bull terrier, pit bull terrier": 180,
+    "American alligator, Alligator mississipiensis": 50,
+    "American black bear, black bear, Ursus americanus, Euarctos americanus": 295,
+    "American chameleon, anole, Anolis carolinensis": 40,
+    "American coot, marsh hen, mud hen, water hen, Fulica americana": 137,
+    "American egret, great white heron, Egretta albus": 132,
+    "American lobster, Northern lobster, Maine lobster, Homarus americanus": 122,
+    "Angora, Angora rabbit": 332,
+    "Appenzeller": 240,
+    "Arabian camel, dromedary, Camelus dromedarius": 354,
+    "Arctic fox, white fox, Alopex lagopus": 279,
+    "Australian terrier": 193,
+    "Band Aid": 419,
+    "Bedlington terrier": 181,
+    "Bernese mountain dog": 239,
+    "Blenheim spaniel": 156,
+    "Border collie": 232,
+    "Border terrier": 182,
+    "Boston bull, Boston terrier": 195,
+    "Bouvier des Flandres, Bouviers des Flandres": 233,
+    "Brabancon griffon": 262,
+    "Brittany spaniel": 215,
+    "CD player": 485,
+    "Cardigan, Cardigan Welsh corgi": 264,
+    "Chesapeake Bay retriever": 209,
+    "Chihuahua": 151,
+    "Christmas stocking": 496,
+    "Crock Pot": 521,
+    "Dandie Dinmont, Dandie Dinmont terrier": 194,
+    "Doberman, Doberman pinscher": 236,
+    "Dungeness crab, Cancer magister": 118,
+    "Dutch oven": 544,
+    "Egyptian cat": 285,
+    "English foxhound": 167,
+    "English setter": 212,
+    "English springer, English springer spaniel": 217,
+    "EntleBucher": 241,
+    "Eskimo dog, husky": 248,
+    "European fire salamander, Salamandra salamandra": 25,
+    "European gallinule, Porphyrio porphyrio": 136,
+    "French bulldog": 245,
+    "French horn, horn": 566,
+    "French loaf": 930,
+    "German shepherd, German shepherd dog, German police dog, alsatian": 235,
+    "German short-haired pointer": 210,
+    "Gila monster, Heloderma suspectum": 45,
+    "Gordon setter": 214,
+    "Granny Smith": 948,
+    "Great Dane": 246,
+    "Great Pyrenees": 257,
+    "Greater Swiss Mountain dog": 238,
+    "Ibizan hound, Ibizan Podenco": 173,
+    "Indian cobra, Naja naja": 63,
+    "Indian elephant, Elephas maximus": 385,
+    "Irish setter, red setter": 213,
+    "Irish terrier": 184,
+    "Irish water spaniel": 221,
+    "Irish wolfhound": 170,
+    "Italian greyhound": 171,
+    "Japanese spaniel": 152,
+    "Kerry blue terrier": 183,
+    "Komodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensis": 48,
+    "Labrador retriever": 208,
+    "Lakeland terrier": 189,
+    "Leonberg": 255,
+    "Lhasa, Lhasa apso": 204,
+    "Loafer": 630,
+    "Madagascar cat, ring-tailed lemur, Lemur catta": 383,
+    "Maltese dog, Maltese terrier, Maltese": 153,
+    "Mexican hairless": 268,
+    "Model T": 661,
+    "Newfoundland, Newfoundland dog": 256,
+    "Norfolk terrier": 185,
+    "Norwegian elkhound, elkhound": 174,
+    "Norwich terrier": 186,
+    "Old English sheepdog, bobtail": 229,
+    "Pekinese, Pekingese, Peke": 154,
+    "Pembroke, Pembroke Welsh corgi": 263,
+    "Persian cat": 283,
+    "Petri dish": 712,
+    "Polaroid camera, Polaroid Land camera": 732,
+    "Pomeranian": 259,
+    "Rhodesian ridgeback": 159,
+    "Rottweiler": 234,
+    "Saint Bernard, St Bernard": 247,
+    "Saluki, gazelle hound": 176,
+    "Samoyed, Samoyede": 258,
+    "Scotch terrier, Scottish terrier, Scottie": 199,
+    "Scottish deerhound, deerhound": 177,
+    "Sealyham terrier, Sealyham": 190,
+    "Shetland sheepdog, Shetland sheep dog, Shetland": 230,
+    "Shih-Tzu": 155,
+    "Siamese cat, Siamese": 284,
+    "Siberian husky": 250,
+    "Staffordshire bullterrier, Staffordshire bull terrier": 179,
+    "Sussex spaniel": 220,
+    "Tibetan mastiff": 244,
+    "Tibetan terrier, chrysanthemum dog": 200,
+    "Walker hound, Walker foxhound": 166,
+    "Weimaraner": 178,
+    "Welsh springer spaniel": 218,
+    "West Highland white terrier": 203,
+    "Windsor tie": 906,
+    "Yorkshire terrier": 187,
+    "abacus": 398,
+    "abaya": 399,
+    "academic gown, academic robe, judge's robe": 400,
+    "accordion, piano accordion, squeeze box": 401,
+    "acorn": 988,
+    "acorn squash": 941,
+    "acoustic guitar": 402,
+    "admiral": 321,
+    "affenpinscher, monkey pinscher, monkey dog": 252,
+    "agama": 42,
+    "agaric": 992,
+    "aircraft carrier, carrier, flattop, attack aircraft carrier": 403,
+    "airliner": 404,
+    "airship, dirigible": 405,
+    "albatross, mollymawk": 146,
+    "alligator lizard": 44,
+    "alp": 970,
+    "altar": 406,
+    "ambulance": 407,
+    "amphibian, amphibious vehicle": 408,
+    "analog clock": 409,
+    "anemone fish": 393,
+    "ant, emmet, pismire": 310,
+    "apiary, bee house": 410,
+    "apron": 411,
+    "armadillo": 363,
+    "artichoke, globe artichoke": 944,
+    "ashcan, trash can, garbage can, wastebin, ash bin, ash-bin, ashbin, dustbin, trash barrel, trash bin": 412,
+    "assault rifle, assault gun": 413,
+    "axolotl, mud puppy, Ambystoma mexicanum": 29,
+    "baboon": 372,
+    "backpack, back pack, knapsack, packsack, rucksack, haversack": 414,
+    "badger": 362,
+    "bagel, beigel": 931,
+    "bakery, bakeshop, bakehouse": 415,
+    "balance beam, beam": 416,
+    "bald eagle, American eagle, Haliaeetus leucocephalus": 22,
+    "balloon": 417,
+    "ballplayer, baseball player": 981,
+    "ballpoint, ballpoint pen, ballpen, Biro": 418,
+    "banana": 954,
+    "banded gecko": 38,
+    "banjo": 420,
+    "bannister, banister, balustrade, balusters, handrail": 421,
+    "barbell": 422,
+    "barber chair": 423,
+    "barbershop": 424,
+    "barn": 425,
+    "barn spider, Araneus cavaticus": 73,
+    "barometer": 426,
+    "barracouta, snoek": 389,
+    "barrel, cask": 427,
+    "barrow, garden cart, lawn cart, wheelbarrow": 428,
+    "baseball": 429,
+    "basenji": 253,
+    "basketball": 430,
+    "basset, basset hound": 161,
+    "bassinet": 431,
+    "bassoon": 432,
+    "bath towel": 434,
+    "bathing cap, swimming cap": 433,
+    "bathtub, bathing tub, bath, tub": 435,
+    "beach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggon": 436,
+    "beacon, lighthouse, beacon light, pharos": 437,
+    "beagle": 162,
+    "beaker": 438,
+    "bearskin, busby, shako": 439,
+    "beaver": 337,
+    "bee": 309,
+    "bee eater": 92,
+    "beer bottle": 440,
+    "beer glass": 441,
+    "bell cote, bell cot": 442,
+    "bell pepper": 945,
+    "bib": 443,
+    "bicycle-built-for-two, tandem bicycle, tandem": 444,
+    "bighorn, bighorn sheep, cimarron, Rocky Mountain bighorn, Rocky Mountain sheep, Ovis canadensis": 349,
+    "bikini, two-piece": 445,
+    "binder, ring-binder": 446,
+    "binoculars, field glasses, opera glasses": 447,
+    "birdhouse": 448,
+    "bison": 347,
+    "bittern": 133,
+    "black and gold garden spider, Argiope aurantia": 72,
+    "black grouse": 80,
+    "black stork, Ciconia nigra": 128,
+    "black swan, Cygnus atratus": 100,
+    "black widow, Latrodectus mactans": 75,
+    "black-and-tan coonhound": 165,
+    "black-footed ferret, ferret, Mustela nigripes": 359,
+    "bloodhound, sleuthhound": 163,
+    "bluetick": 164,
+    "boa constrictor, Constrictor constrictor": 61,
+    "boathouse": 449,
+    "bobsled, bobsleigh, bob": 450,
+    "bolete": 997,
+    "bolo tie, bolo, bola tie, bola": 451,
+    "bonnet, poke bonnet": 452,
+    "book jacket, dust cover, dust jacket, dust wrapper": 921,
+    "bookcase": 453,
+    "bookshop, bookstore, bookstall": 454,
+    "borzoi, Russian wolfhound": 169,
+    "bottlecap": 455,
+    "bow": 456,
+    "bow tie, bow-tie, bowtie": 457,
+    "box turtle, box tortoise": 37,
+    "boxer": 242,
+    "brain coral": 109,
+    "brambling, Fringilla montifringilla": 10,
+    "brass, memorial tablet, plaque": 458,
+    "brassiere, bra, bandeau": 459,
+    "breakwater, groin, groyne, mole, bulwark, seawall, jetty": 460,
+    "breastplate, aegis, egis": 461,
+    "briard": 226,
+    "broccoli": 937,
+    "broom": 462,
+    "brown bear, bruin, Ursus arctos": 294,
+    "bubble": 971,
+    "bucket, pail": 463,
+    "buckeye, horse chestnut, conker": 990,
+    "buckle": 464,
+    "bulbul": 16,
+    "bull mastiff": 243,
+    "bullet train, bullet": 466,
+    "bulletproof vest": 465,
+    "bullfrog, Rana catesbeiana": 30,
+    "burrito": 965,
+    "bustard": 138,
+    "butcher shop, meat market": 467,
+    "butternut squash": 942,
+    "cab, hack, taxi, taxicab": 468,
+    "cabbage butterfly": 324,
+    "cairn, cairn terrier": 192,
+    "caldron, cauldron": 469,
+    "can opener, tin opener": 473,
+    "candle, taper, wax light": 470,
+    "cannon": 471,
+    "canoe": 472,
+    "capuchin, ringtail, Cebus capucinus": 378,
+    "car mirror": 475,
+    "car wheel": 479,
+    "carbonara": 959,
+    "cardigan": 474,
+    "cardoon": 946,
+    "carousel, carrousel, merry-go-round, roundabout, whirligig": 476,
+    "carpenter's kit, tool kit": 477,
+    "carton": 478,
+    "cash machine, cash dispenser, automated teller machine, automatic teller machine, automated teller, automatic teller, ATM": 480,
+    "cassette": 481,
+    "cassette player": 482,
+    "castle": 483,
+    "catamaran": 484,
+    "cauliflower": 938,
+    "cello, violoncello": 486,
+    "cellular telephone, cellular phone, cellphone, cell, mobile phone": 487,
+    "centipede": 79,
+    "chain": 488,
+    "chain mail, ring mail, mail, chain armor, chain armour, ring armor, ring armour": 490,
+    "chain saw, chainsaw": 491,
+    "chainlink fence": 489,
+    "chambered nautilus, pearly nautilus, nautilus": 117,
+    "cheeseburger": 933,
+    "cheetah, chetah, Acinonyx jubatus": 293,
+    "chest": 492,
+    "chickadee": 19,
+    "chiffonier, commode": 493,
+    "chime, bell, gong": 494,
+    "chimpanzee, chimp, Pan troglodytes": 367,
+    "china cabinet, china closet": 495,
+    "chiton, coat-of-mail shell, sea cradle, polyplacophore": 116,
+    "chocolate sauce, chocolate syrup": 960,
+    "chow, chow chow": 260,
+    "church, church building": 497,
+    "cicada, cicala": 316,
+    "cinema, movie theater, movie theatre, movie house, picture palace": 498,
+    "cleaver, meat cleaver, chopper": 499,
+    "cliff dwelling": 500,
+    "cliff, drop, drop-off": 972,
+    "cloak": 501,
+    "clog, geta, patten, sabot": 502,
+    "clumber, clumber spaniel": 216,
+    "cock": 7,
+    "cocker spaniel, English cocker spaniel, cocker": 219,
+    "cockroach, roach": 314,
+    "cocktail shaker": 503,
+    "coffee mug": 504,
+    "coffeepot": 505,
+    "coho, cohoe, coho salmon, blue jack, silver salmon, Oncorhynchus kisutch": 391,
+    "coil, spiral, volute, whorl, helix": 506,
+    "collie": 231,
+    "colobus, colobus monkey": 375,
+    "combination lock": 507,
+    "comic book": 917,
+    "common iguana, iguana, Iguana iguana": 39,
+    "common newt, Triturus vulgaris": 26,
+    "computer keyboard, keypad": 508,
+    "conch": 112,
+    "confectionery, confectionary, candy store": 509,
+    "consomme": 925,
+    "container ship, containership, container vessel": 510,
+    "convertible": 511,
+    "coral fungus": 991,
+    "coral reef": 973,
+    "corkscrew, bottle screw": 512,
+    "corn": 987,
+    "cornet, horn, trumpet, trump": 513,
+    "coucal": 91,
+    "cougar, puma, catamount, mountain lion, painter, panther, Felis concolor": 286,
+    "cowboy boot": 514,
+    "cowboy hat, ten-gallon hat": 515,
+    "coyote, prairie wolf, brush wolf, Canis latrans": 272,
+    "cradle": 516,
+    "crane": 517,
+    "crash helmet": 518,
+    "crate": 519,
+    "crayfish, crawfish, crawdad, crawdaddy": 124,
+    "crib, cot": 520,
+    "cricket": 312,
+    "croquet ball": 522,
+    "crossword puzzle, crossword": 918,
+    "crutch": 523,
+    "cucumber, cuke": 943,
+    "cuirass": 524,
+    "cup": 968,
+    "curly-coated retriever": 206,
+    "custard apple": 956,
+    "daisy": 985,
+    "dalmatian, coach dog, carriage dog": 251,
+    "dam, dike, dyke": 525,
+    "damselfly": 320,
+    "desk": 526,
+    "desktop computer": 527,
+    "dhole, Cuon alpinus": 274,
+    "dial telephone, dial phone": 528,
+    "diamondback, diamondback rattlesnake, Crotalus adamanteus": 67,
+    "diaper, nappy, napkin": 529,
+    "digital clock": 530,
+    "digital watch": 531,
+    "dingo, warrigal, warragal, Canis dingo": 273,
+    "dining table, board": 532,
+    "dishrag, dishcloth": 533,
+    "dishwasher, dish washer, dishwashing machine": 534,
+    "disk brake, disc brake": 535,
+    "dock, dockage, docking facility": 536,
+    "dogsled, dog sled, dog sleigh": 537,
+    "dome": 538,
+    "doormat, welcome mat": 539,
+    "dough": 961,
+    "dowitcher": 142,
+    "dragonfly, darning needle, devil's darning needle, sewing needle, snake feeder, snake doctor, mosquito hawk, skeeter hawk": 319,
+    "drake": 97,
+    "drilling platform, offshore rig": 540,
+    "drum, membranophone, tympan": 541,
+    "drumstick": 542,
+    "dugong, Dugong dugon": 149,
+    "dumbbell": 543,
+    "dung beetle": 305,
+    "ear, spike, capitulum": 998,
+    "earthstar": 995,
+    "echidna, spiny anteater, anteater": 102,
+    "eel": 390,
+    "eft": 27,
+    "eggnog": 969,
+    "electric fan, blower": 545,
+    "electric guitar": 546,
+    "electric locomotive": 547,
+    "electric ray, crampfish, numbfish, torpedo": 5,
+    "entertainment center": 548,
+    "envelope": 549,
+    "espresso": 967,
+    "espresso maker": 550,
+    "face powder": 551,
+    "feather boa, boa": 552,
+    "fiddler crab": 120,
+    "fig": 952,
+    "file, file cabinet, filing cabinet": 553,
+    "fire engine, fire truck": 555,
+    "fire screen, fireguard": 556,
+    "fireboat": 554,
+    "flagpole, flagstaff": 557,
+    "flamingo": 130,
+    "flat-coated retriever": 205,
+    "flatworm, platyhelminth": 110,
+    "flute, transverse flute": 558,
+    "fly": 308,
+    "folding chair": 559,
+    "football helmet": 560,
+    "forklift": 561,
+    "fountain": 562,
+    "fountain pen": 563,
+    "four-poster": 564,
+    "fox squirrel, eastern fox squirrel, Sciurus niger": 335,
+    "freight car": 565,
+    "frilled lizard, Chlamydosaurus kingi": 43,
+    "frying pan, frypan, skillet": 567,
+    "fur coat": 568,
+    "gar, garfish, garpike, billfish, Lepisosteus osseus": 395,
+    "garbage truck, dustcart": 569,
+    "garden spider, Aranea diademata": 74,
+    "garter snake, grass snake": 57,
+    "gas pump, gasoline pump, petrol pump, island dispenser": 571,
+    "gasmask, respirator, gas helmet": 570,
+    "gazelle": 353,
+    "geyser": 974,
+    "giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca": 388,
+    "giant schnauzer": 197,
+    "gibbon, Hylobates lar": 368,
+    "go-kart": 573,
+    "goblet": 572,
+    "golden retriever": 207,
+    "goldfinch, Carduelis carduelis": 11,
+    "goldfish, Carassius auratus": 1,
+    "golf ball": 574,
+    "golfcart, golf cart": 575,
+    "gondola": 576,
+    "gong, tam-tam": 577,
+    "goose": 99,
+    "gorilla, Gorilla gorilla": 366,
+    "gown": 578,
+    "grand piano, grand": 579,
+    "grasshopper, hopper": 311,
+    "great grey owl, great gray owl, Strix nebulosa": 24,
+    "great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias": 2,
+    "green lizard, Lacerta viridis": 46,
+    "green mamba": 64,
+    "green snake, grass snake": 55,
+    "greenhouse, nursery, glasshouse": 580,
+    "grey fox, gray fox, Urocyon cinereoargenteus": 280,
+    "grey whale, gray whale, devilfish, Eschrichtius gibbosus, Eschrichtius robustus": 147,
+    "grille, radiator grille": 581,
+    "grocery store, grocery, food market, market": 582,
+    "groenendael": 224,
+    "groom, bridegroom": 982,
+    "ground beetle, carabid beetle": 302,
+    "guacamole": 924,
+    "guenon, guenon monkey": 370,
+    "guillotine": 583,
+    "guinea pig, Cavia cobaya": 338,
+    "gyromitra": 993,
+    "hair slide": 584,
+    "hair spray": 585,
+    "half track": 586,
+    "hammer": 587,
+    "hammerhead, hammerhead shark": 4,
+    "hamper": 588,
+    "hamster": 333,
+    "hand blower, blow dryer, blow drier, hair dryer, hair drier": 589,
+    "hand-held computer, hand-held microcomputer": 590,
+    "handkerchief, hankie, hanky, hankey": 591,
+    "hard disc, hard disk, fixed disk": 592,
+    "hare": 331,
+    "harmonica, mouth organ, harp, mouth harp": 593,
+    "harp": 594,
+    "hartebeest": 351,
+    "harvester, reaper": 595,
+    "harvestman, daddy longlegs, Phalangium opilio": 70,
+    "hatchet": 596,
+    "hay": 958,
+    "head cabbage": 936,
+    "hen": 8,
+    "hen-of-the-woods, hen of the woods, Polyporus frondosus, Grifola frondosa": 996,
+    "hermit crab": 125,
+    "hip, rose hip, rosehip": 989,
+    "hippopotamus, hippo, river horse, Hippopotamus amphibius": 344,
+    "hog, pig, grunter, squealer, Sus scrofa": 341,
+    "hognose snake, puff adder, sand viper": 54,
+    "holster": 597,
+    "home theater, home theatre": 598,
+    "honeycomb": 599,
+    "hook, claw": 600,
+    "hoopskirt, crinoline": 601,
+    "horizontal bar, high bar": 602,
+    "hornbill": 93,
+    "horned viper, cerastes, sand viper, horned asp, Cerastes cornutus": 66,
+    "horse cart, horse-cart": 603,
+    "hot pot, hotpot": 926,
+    "hotdog, hot dog, red hot": 934,
+    "hourglass": 604,
+    "house finch, linnet, Carpodacus mexicanus": 12,
+    "howler monkey, howler": 379,
+    "hummingbird": 94,
+    "hyena, hyaena": 276,
+    "iPod": 605,
+    "ibex, Capra ibex": 350,
+    "ice bear, polar bear, Ursus Maritimus, Thalarctos maritimus": 296,
+    "ice cream, icecream": 928,
+    "ice lolly, lolly, lollipop, popsicle": 929,
+    "impala, Aepyceros melampus": 352,
+    "indigo bunting, indigo finch, indigo bird, Passerina cyanea": 14,
+    "indri, indris, Indri indri, Indri brevicaudatus": 384,
+    "iron, smoothing iron": 606,
+    "isopod": 126,
+    "jacamar": 95,
+    "jack-o'-lantern": 607,
+    "jackfruit, jak, jack": 955,
+    "jaguar, panther, Panthera onca, Felis onca": 290,
+    "jay": 17,
+    "jean, blue jean, denim": 608,
+    "jeep, landrover": 609,
+    "jellyfish": 107,
+    "jersey, T-shirt, tee shirt": 610,
+    "jigsaw puzzle": 611,
+    "jinrikisha, ricksha, rickshaw": 612,
+    "joystick": 613,
+    "junco, snowbird": 13,
+    "keeshond": 261,
+    "kelpie": 227,
+    "killer whale, killer, orca, grampus, sea wolf, Orcinus orca": 148,
+    "kimono": 614,
+    "king crab, Alaska crab, Alaskan king crab, Alaska king crab, Paralithodes camtschatica": 121,
+    "king penguin, Aptenodytes patagonica": 145,
+    "king snake, kingsnake": 56,
+    "kit fox, Vulpes macrotis": 278,
+    "kite": 21,
+    "knee pad": 615,
+    "knot": 616,
+    "koala, koala bear, kangaroo bear, native bear, Phascolarctos cinereus": 105,
+    "komondor": 228,
+    "kuvasz": 222,
+    "lab coat, laboratory coat": 617,
+    "lacewing, lacewing fly": 318,
+    "ladle": 618,
+    "ladybug, ladybeetle, lady beetle, ladybird, ladybird beetle": 301,
+    "lakeside, lakeshore": 975,
+    "lampshade, lamp shade": 619,
+    "langur": 374,
+    "laptop, laptop computer": 620,
+    "lawn mower, mower": 621,
+    "leaf beetle, chrysomelid": 304,
+    "leafhopper": 317,
+    "leatherback turtle, leatherback, leathery turtle, Dermochelys coriacea": 34,
+    "lemon": 951,
+    "lens cap, lens cover": 622,
+    "leopard, Panthera pardus": 288,
+    "lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens": 387,
+    "letter opener, paper knife, paperknife": 623,
+    "library": 624,
+    "lifeboat": 625,
+    "lighter, light, igniter, ignitor": 626,
+    "limousine, limo": 627,
+    "limpkin, Aramus pictus": 135,
+    "liner, ocean liner": 628,
+    "lion, king of beasts, Panthera leo": 291,
+    "lionfish": 396,
+    "lipstick, lip rouge": 629,
+    "little blue heron, Egretta caerulea": 131,
+    "llama": 355,
+    "loggerhead, loggerhead turtle, Caretta caretta": 33,
+    "long-horned beetle, longicorn, longicorn beetle": 303,
+    "lorikeet": 90,
+    "lotion": 631,
+    "loudspeaker, speaker, speaker unit, loudspeaker system, speaker system": 632,
+    "loupe, jeweler's loupe": 633,
+    "lumbermill, sawmill": 634,
+    "lycaenid, lycaenid butterfly": 326,
+    "lynx, catamount": 287,
+    "macaque": 373,
+    "macaw": 88,
+    "magnetic compass": 635,
+    "magpie": 18,
+    "mailbag, postbag": 636,
+    "mailbox, letter box": 637,
+    "maillot": 638,
+    "maillot, tank suit": 639,
+    "malamute, malemute, Alaskan malamute": 249,
+    "malinois": 225,
+    "manhole cover": 640,
+    "mantis, mantid": 315,
+    "maraca": 641,
+    "marimba, xylophone": 642,
+    "marmoset": 377,
+    "marmot": 336,
+    "mashed potato": 935,
+    "mask": 643,
+    "matchstick": 644,
+    "maypole": 645,
+    "maze, labyrinth": 646,
+    "measuring cup": 647,
+    "meat loaf, meatloaf": 962,
+    "medicine chest, medicine cabinet": 648,
+    "meerkat, mierkat": 299,
+    "megalith, megalithic structure": 649,
+    "menu": 922,
+    "microphone, mike": 650,
+    "microwave, microwave oven": 651,
+    "military uniform": 652,
+    "milk can": 653,
+    "miniature pinscher": 237,
+    "miniature poodle": 266,
+    "miniature schnauzer": 196,
+    "minibus": 654,
+    "miniskirt, mini": 655,
+    "minivan": 656,
+    "mink": 357,
+    "missile": 657,
+    "mitten": 658,
+    "mixing bowl": 659,
+    "mobile home, manufactured home": 660,
+    "modem": 662,
+    "monarch, monarch butterfly, milkweed butterfly, Danaus plexippus": 323,
+    "monastery": 663,
+    "mongoose": 298,
+    "monitor": 664,
+    "moped": 665,
+    "mortar": 666,
+    "mortarboard": 667,
+    "mosque": 668,
+    "mosquito net": 669,
+    "motor scooter, scooter": 670,
+    "mountain bike, all-terrain bike, off-roader": 671,
+    "mountain tent": 672,
+    "mouse, computer mouse": 673,
+    "mousetrap": 674,
+    "moving van": 675,
+    "mud turtle": 35,
+    "mushroom": 947,
+    "muzzle": 676,
+    "nail": 677,
+    "neck brace": 678,
+    "necklace": 679,
+    "nematode, nematode worm, roundworm": 111,
+    "night snake, Hypsiglena torquata": 60,
+    "nipple": 680,
+    "notebook, notebook computer": 681,
+    "obelisk": 682,
+    "oboe, hautboy, hautbois": 683,
+    "ocarina, sweet potato": 684,
+    "odometer, hodometer, mileometer, milometer": 685,
+    "oil filter": 686,
+    "orange": 950,
+    "orangutan, orang, orangutang, Pongo pygmaeus": 365,
+    "organ, pipe organ": 687,
+    "oscilloscope, scope, cathode-ray oscilloscope, CRO": 688,
+    "ostrich, Struthio camelus": 9,
+    "otter": 360,
+    "otterhound, otter hound": 175,
+    "overskirt": 689,
+    "ox": 345,
+    "oxcart": 690,
+    "oxygen mask": 691,
+    "oystercatcher, oyster catcher": 143,
+    "packet": 692,
+    "paddle, boat paddle": 693,
+    "paddlewheel, paddle wheel": 694,
+    "padlock": 695,
+    "paintbrush": 696,
+    "pajama, pyjama, pj's, jammies": 697,
+    "palace": 698,
+    "panpipe, pandean pipe, syrinx": 699,
+    "paper towel": 700,
+    "papillon": 157,
+    "parachute, chute": 701,
+    "parallel bars, bars": 702,
+    "park bench": 703,
+    "parking meter": 704,
+    "partridge": 86,
+    "passenger car, coach, carriage": 705,
+    "patas, hussar monkey, Erythrocebus patas": 371,
+    "patio, terrace": 706,
+    "pay-phone, pay-station": 707,
+    "peacock": 84,
+    "pedestal, plinth, footstall": 708,
+    "pelican": 144,
+    "pencil box, pencil case": 709,
+    "pencil sharpener": 710,
+    "perfume, essence": 711,
+    "photocopier": 713,
+    "pick, plectrum, plectron": 714,
+    "pickelhaube": 715,
+    "picket fence, paling": 716,
+    "pickup, pickup truck": 717,
+    "pier": 718,
+    "piggy bank, penny bank": 719,
+    "pill bottle": 720,
+    "pillow": 721,
+    "pineapple, ananas": 953,
+    "ping-pong ball": 722,
+    "pinwheel": 723,
+    "pirate, pirate ship": 724,
+    "pitcher, ewer": 725,
+    "pizza, pizza pie": 963,
+    "plane, carpenter's plane, woodworking plane": 726,
+    "planetarium": 727,
+    "plastic bag": 728,
+    "plate": 923,
+    "plate rack": 729,
+    "platypus, duckbill, duckbilled platypus, duck-billed platypus, Ornithorhynchus anatinus": 103,
+    "plow, plough": 730,
+    "plunger, plumber's helper": 731,
+    "pole": 733,
+    "polecat, fitch, foulmart, foumart, Mustela putorius": 358,
+    "police van, police wagon, paddy wagon, patrol wagon, wagon, black Maria": 734,
+    "pomegranate": 957,
+    "poncho": 735,
+    "pool table, billiard table, snooker table": 736,
+    "pop bottle, soda bottle": 737,
+    "porcupine, hedgehog": 334,
+    "pot, flowerpot": 738,
+    "potpie": 964,
+    "potter's wheel": 739,
+    "power drill": 740,
+    "prairie chicken, prairie grouse, prairie fowl": 83,
+    "prayer rug, prayer mat": 741,
+    "pretzel": 932,
+    "printer": 742,
+    "prison, prison house": 743,
+    "proboscis monkey, Nasalis larvatus": 376,
+    "projectile, missile": 744,
+    "projector": 745,
+    "promontory, headland, head, foreland": 976,
+    "ptarmigan": 81,
+    "puck, hockey puck": 746,
+    "puffer, pufferfish, blowfish, globefish": 397,
+    "pug, pug-dog": 254,
+    "punching bag, punch bag, punching ball, punchball": 747,
+    "purse": 748,
+    "quail": 85,
+    "quill, quill pen": 749,
+    "quilt, comforter, comfort, puff": 750,
+    "racer, race car, racing car": 751,
+    "racket, racquet": 752,
+    "radiator": 753,
+    "radio telescope, radio reflector": 755,
+    "radio, wireless": 754,
+    "rain barrel": 756,
+    "ram, tup": 348,
+    "rapeseed": 984,
+    "recreational vehicle, RV, R.V.": 757,
+    "red fox, Vulpes vulpes": 277,
+    "red wine": 966,
+    "red wolf, maned wolf, Canis rufus, Canis niger": 271,
+    "red-backed sandpiper, dunlin, Erolia alpina": 140,
+    "red-breasted merganser, Mergus serrator": 98,
+    "redbone": 168,
+    "redshank, Tringa totanus": 141,
+    "reel": 758,
+    "reflex camera": 759,
+    "refrigerator, icebox": 760,
+    "remote control, remote": 761,
+    "restaurant, eating house, eating place, eatery": 762,
+    "revolver, six-gun, six-shooter": 763,
+    "rhinoceros beetle": 306,
+    "rifle": 764,
+    "ringlet, ringlet butterfly": 322,
+    "ringneck snake, ring-necked snake, ring snake": 53,
+    "robin, American robin, Turdus migratorius": 15,
+    "rock beauty, Holocanthus tricolor": 392,
+    "rock crab, Cancer irroratus": 119,
+    "rock python, rock snake, Python sebae": 62,
+    "rocking chair, rocker": 765,
+    "rotisserie": 766,
+    "rubber eraser, rubber, pencil eraser": 767,
+    "ruddy turnstone, Arenaria interpres": 139,
+    "ruffed grouse, partridge, Bonasa umbellus": 82,
+    "rugby ball": 768,
+    "rule, ruler": 769,
+    "running shoe": 770,
+    "safe": 771,
+    "safety pin": 772,
+    "saltshaker, salt shaker": 773,
+    "sandal": 774,
+    "sandbar, sand bar": 977,
+    "sarong": 775,
+    "sax, saxophone": 776,
+    "scabbard": 777,
+    "scale, weighing machine": 778,
+    "schipperke": 223,
+    "school bus": 779,
+    "schooner": 780,
+    "scoreboard": 781,
+    "scorpion": 71,
+    "screen, CRT screen": 782,
+    "screw": 783,
+    "screwdriver": 784,
+    "scuba diver": 983,
+    "sea anemone, anemone": 108,
+    "sea cucumber, holothurian": 329,
+    "sea lion": 150,
+    "sea slug, nudibranch": 115,
+    "sea snake": 65,
+    "sea urchin": 328,
+    "seashore, coast, seacoast, sea-coast": 978,
+    "seat belt, seatbelt": 785,
+    "sewing machine": 786,
+    "shield, buckler": 787,
+    "shoe shop, shoe-shop, shoe store": 788,
+    "shoji": 789,
+    "shopping basket": 790,
+    "shopping cart": 791,
+    "shovel": 792,
+    "shower cap": 793,
+    "shower curtain": 794,
+    "siamang, Hylobates syndactylus, Symphalangus syndactylus": 369,
+    "sidewinder, horned rattlesnake, Crotalus cerastes": 68,
+    "silky terrier, Sydney silky": 201,
+    "ski": 795,
+    "ski mask": 796,
+    "skunk, polecat, wood pussy": 361,
+    "sleeping bag": 797,
+    "slide rule, slipstick": 798,
+    "sliding door": 799,
+    "slot, one-armed bandit": 800,
+    "sloth bear, Melursus ursinus, Ursus ursinus": 297,
+    "slug": 114,
+    "snail": 113,
+    "snorkel": 801,
+    "snow leopard, ounce, Panthera uncia": 289,
+    "snowmobile": 802,
+    "snowplow, snowplough": 803,
+    "soap dispenser": 804,
+    "soccer ball": 805,
+    "sock": 806,
+    "soft-coated wheaten terrier": 202,
+    "solar dish, solar collector, solar furnace": 807,
+    "sombrero": 808,
+    "sorrel": 339,
+    "soup bowl": 809,
+    "space bar": 810,
+    "space heater": 811,
+    "space shuttle": 812,
+    "spaghetti squash": 940,
+    "spatula": 813,
+    "speedboat": 814,
+    "spider monkey, Ateles geoffroyi": 381,
+    "spider web, spider's web": 815,
+    "spindle": 816,
+    "spiny lobster, langouste, rock lobster, crawfish, crayfish, sea crawfish": 123,
+    "spoonbill": 129,
+    "sports car, sport car": 817,
+    "spotlight, spot": 818,
+    "spotted salamander, Ambystoma maculatum": 28,
+    "squirrel monkey, Saimiri sciureus": 382,
+    "stage": 819,
+    "standard poodle": 267,
+    "standard schnauzer": 198,
+    "starfish, sea star": 327,
+    "steam locomotive": 820,
+    "steel arch bridge": 821,
+    "steel drum": 822,
+    "stethoscope": 823,
+    "stingray": 6,
+    "stinkhorn, carrion fungus": 994,
+    "stole": 824,
+    "stone wall": 825,
+    "stopwatch, stop watch": 826,
+    "stove": 827,
+    "strainer": 828,
+    "strawberry": 949,
+    "street sign": 919,
+    "streetcar, tram, tramcar, trolley, trolley car": 829,
+    "stretcher": 830,
+    "studio couch, day bed": 831,
+    "stupa, tope": 832,
+    "sturgeon": 394,
+    "submarine, pigboat, sub, U-boat": 833,
+    "suit, suit of clothes": 834,
+    "sulphur butterfly, sulfur butterfly": 325,
+    "sulphur-crested cockatoo, Kakatoe galerita, Cacatua galerita": 89,
+    "sundial": 835,
+    "sunglass": 836,
+    "sunglasses, dark glasses, shades": 837,
+    "sunscreen, sunblock, sun blocker": 838,
+    "suspension bridge": 839,
+    "swab, swob, mop": 840,
+    "sweatshirt": 841,
+    "swimming trunks, bathing trunks": 842,
+    "swing": 843,
+    "switch, electric switch, electrical switch": 844,
+    "syringe": 845,
+    "tabby, tabby cat": 281,
+    "table lamp": 846,
+    "tailed frog, bell toad, ribbed toad, tailed toad, Ascaphus trui": 32,
+    "tank, army tank, armored combat vehicle, armoured combat vehicle": 847,
+    "tape player": 848,
+    "tarantula": 76,
+    "teapot": 849,
+    "teddy, teddy bear": 850,
+    "television, television system": 851,
+    "tench, Tinca tinca": 0,
+    "tennis ball": 852,
+    "terrapin": 36,
+    "thatch, thatched roof": 853,
+    "theater curtain, theatre curtain": 854,
+    "thimble": 855,
+    "three-toed sloth, ai, Bradypus tridactylus": 364,
+    "thresher, thrasher, threshing machine": 856,
+    "throne": 857,
+    "thunder snake, worm snake, Carphophis amoenus": 52,
+    "tick": 78,
+    "tiger beetle": 300,
+    "tiger cat": 282,
+    "tiger shark, Galeocerdo cuvieri": 3,
+    "tiger, Panthera tigris": 292,
+    "tile roof": 858,
+    "timber wolf, grey wolf, gray wolf, Canis lupus": 269,
+    "titi, titi monkey": 380,
+    "toaster": 859,
+    "tobacco shop, tobacconist shop, tobacconist": 860,
+    "toilet seat": 861,
+    "toilet tissue, toilet paper, bathroom tissue": 999,
+    "torch": 862,
+    "totem pole": 863,
+    "toucan": 96,
+    "tow truck, tow car, wrecker": 864,
+    "toy poodle": 265,
+    "toy terrier": 158,
+    "toyshop": 865,
+    "tractor": 866,
+    "traffic light, traffic signal, stoplight": 920,
+    "trailer truck, tractor trailer, trucking rig, rig, articulated lorry, semi": 867,
+    "tray": 868,
+    "tree frog, tree-frog": 31,
+    "trench coat": 869,
+    "triceratops": 51,
+    "tricycle, trike, velocipede": 870,
+    "trifle": 927,
+    "trilobite": 69,
+    "trimaran": 871,
+    "tripod": 872,
+    "triumphal arch": 873,
+    "trolleybus, trolley coach, trackless trolley": 874,
+    "trombone": 875,
+    "tub, vat": 876,
+    "turnstile": 877,
+    "tusker": 101,
+    "typewriter keyboard": 878,
+    "umbrella": 879,
+    "unicycle, monocycle": 880,
+    "upright, upright piano": 881,
+    "vacuum, vacuum cleaner": 882,
+    "valley, vale": 979,
+    "vase": 883,
+    "vault": 884,
+    "velvet": 885,
+    "vending machine": 886,
+    "vestment": 887,
+    "viaduct": 888,
+    "vine snake": 59,
+    "violin, fiddle": 889,
+    "vizsla, Hungarian pointer": 211,
+    "volcano": 980,
+    "volleyball": 890,
+    "vulture": 23,
+    "waffle iron": 891,
+    "walking stick, walkingstick, stick insect": 313,
+    "wall clock": 892,
+    "wallaby, brush kangaroo": 104,
+    "wallet, billfold, notecase, pocketbook": 893,
+    "wardrobe, closet, press": 894,
+    "warplane, military plane": 895,
+    "warthog": 343,
+    "washbasin, handbasin, washbowl, lavabo, wash-hand basin": 896,
+    "washer, automatic washer, washing machine": 897,
+    "water bottle": 898,
+    "water buffalo, water ox, Asiatic buffalo, Bubalus bubalis": 346,
+    "water jug": 899,
+    "water ouzel, dipper": 20,
+    "water snake": 58,
+    "water tower": 900,
+    "weasel": 356,
+    "web site, website, internet site, site": 916,
+    "weevil": 307,
+    "whippet": 172,
+    "whiptail, whiptail lizard": 41,
+    "whiskey jug": 901,
+    "whistle": 902,
+    "white stork, Ciconia ciconia": 127,
+    "white wolf, Arctic wolf, Canis lupus tundrarum": 270,
+    "wig": 903,
+    "wild boar, boar, Sus scrofa": 342,
+    "window screen": 904,
+    "window shade": 905,
+    "wine bottle": 907,
+    "wing": 908,
+    "wire-haired fox terrier": 188,
+    "wok": 909,
+    "wolf spider, hunting spider": 77,
+    "wombat": 106,
+    "wood rabbit, cottontail, cottontail rabbit": 330,
+    "wooden spoon": 910,
+    "wool, woolen, woollen": 911,
+    "worm fence, snake fence, snake-rail fence, Virginia fence": 912,
+    "wreck": 913,
+    "yawl": 914,
+    "yellow lady's slipper, yellow lady-slipper, Cypripedium calceolus, Cypripedium parviflorum": 986,
+    "yurt": 915,
+    "zebra": 340,
+    "zucchini, courgette": 939
+  },
+  "max_length": 1024,
+  "model_type": "vmamba",
+  "num_channels": 3,
+  "num_classes": 1000,
+  "num_mel_bins": 128,
+  "patch_size": 4,
+  "torch_dtype": "float32",
+  "transformers_version": "4.50.0.dev0",
+  "use_checkpoint": false
+}

configuration_vmamba.py

@@ -0,0 +1,97 @@
+# coding=utf-8
+# @Author  : Saurabhchand Bhati
+# @Affiliation  : Massachusetts Institute of Technology
+"""VMamba: Visual State Space Model configuration"""
+
+from typing import Any, Dict
+
+from transformers.configuration_utils import PretrainedConfig
+from transformers.utils import logging
+
+
+logger = logging.get_logger(__name__)
+
+class VMambaConfig(PretrainedConfig):
+    r"""
+    This is the configuration class to store the configuration of a [`VMambaModel`]. It is used to instantiate a VMamba
+    model according to the specified arguments, defining the model architecture. Instantiating a configuration with the
+    defaults will yield a similar configuration to that of the
+    [VMamba-T](https://github.com/MzeroMiko/VMamba/) architecture.
+
+    Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
+    documentation from [`PretrainedConfig`] for more information.
+
+    Args:
+        num_channels (`int`, *optional*, defaults to 3):
+            Number of input channels.
+        patch_size (`int`, *optional*, defaults to 4):
+            The size (resolution) of each patch.
+        embed_dim (`int`, *optional*, defaults to 96):
+            Dimensionality of patch embedding.
+        depths (`list(int)`, *optional*, defaults to `[2, 2, 8, 2]`):
+            Depth of each layer in the VMamba encoder.
+        dims (`list(int)`, *optional*, defaults to `[96, 192, 384, 768]`):
+            Dimensionality of each layer in the VMamba encoder.
+        drop_path_rate (`float`, *optional*, defaults to 0.2):
+            Stochastic depth rate.
+        num_classes (`int`, *optional*, defaults to 1000):
+            Number of classes for classification.
+        max_length (`int`, *optional*, defaults to 1024):
+            Temporal dimension of the spectrograms.
+        num_mel_bins (`int`, *optional*, defaults to 128):
+            Frequency dimension of the spectrograms (number of Mel-frequency bins).
+        use_checkpoint (`bool`, *optional*, defaults to `False`):
+            Whether to use checkpointing to save memory.
+
+    Example:
+
+    ```python
+    >>> from transformers import VMambaConfig, VMambaModel
+
+    >>> # Initializing a VMamba tiny style configuration
+    >>> configuration = VMambaConfig()
+
+    >>> # Initializing a model (with random weights) from the VMamba tiny style configuration
+    >>> model = VMambaModel(configuration)
+
+    >>> # Accessing the model configuration
+    >>> configuration = model.config
+    ```"""
+
+    model_type = "vmamba"
+
+    def __init__(
+        self,
+        num_channels: int = 3,
+        patch_size: int = 4,
+        embed_dim: int = 96,
+        depths: list = [2, 2, 8, 2],
+        dims: list =[96, 192, 384, 768],
+        drop_path_rate: float = 0.2,
+        num_classes: int = 1000,
+        max_length: int = 1024,
+        num_mel_bins: int = 128,
+        use_checkpoint: bool = False,
+        **kwargs,
+    ):
+        super().__init__(**kwargs)
+
+        self.num_channels = num_channels
+        self.patch_size = patch_size
+        self.embed_dim = embed_dim
+        self.depths = depths
+        self.dims = dims
+        self.drop_path_rate = drop_path_rate
+        self.num_classes = num_classes
+        self.max_length = max_length
+        self.num_mel_bins = num_mel_bins
+        self.use_checkpoint = use_checkpoint
+
+    # Overwritten from the parent class: VMamba is not compatible with `generate`, but has a config parameter sharing the
+    # same name (`max_length`). Sharing the same name triggers checks regarding the config -> generation_config
+    # generative parameters deprecation cycle, overwriting this function prevents this from happening.
+    def _get_non_default_generation_parameters(self) -> Dict[str, Any]:
+        return {}
+
+
+__all__ = ["VMambaConfig"]

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fd6fb885ddfa33cb259d9c78c72565408d9735959ec14bc72a6e78819f7fa83
+size 196105016

modeling_vmamba.py

@@ -0,0 +1,1220 @@
+# coding=utf-8
+# @Author  : Saurabhchand Bhati
+# @Affiliation  : Massachusetts Institute of Technology
+# VMamba backbone is from https://github.com/MzeroMiko/VMamba/blob/main/vmamba.py
+# VMambaLayer, VMambaModel, VMambaForImageClassification are implemnted based on VMamba
+# SS2Dv0, SS2Dv1, SS2S are merged into one class and initiliazation is limited to v05_noz,
+# patch embeddings is limited to v2 and downsample is limited to v3.
+
+# MIT License
+
+# Copyright (c) 2024 MzeroMiko, Saurabhchand Bhati
+
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+
+# The above copyright notice and this permission notice shall be included in all
+# copies or substantial portions of the Software.
+
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+# SOFTWARE.
+
+"""VMamba: Visual State Space Model configuration model"""
+
+import math
+import torch 
+import warnings
+import torch.nn as nn
+import torch.nn.functional as F
+import torch.utils.checkpoint as checkpoint
+from timm.models.layers import DropPath, trunc_normal_
+from functools import partial
+from typing import Optional, Callable, Any, Union
+from torch.nn import BCEWithLogitsLoss, CrossEntropyLoss
+from transformers.modeling_outputs import ImageClassifierOutput
+
+from transformers.utils import logging
+from transformers.modeling_utils import PreTrainedModel
+
+from .configuration_vmamba import VMambaConfig
+
+logger = logging.get_logger(__name__)
+
+# General docstring
+_CONFIG_FOR_DOC = "VMambaConfig"
+
+WITH_TRITON = True
+# WITH_TRITON = False
+try:
+    import triton
+    import triton.language as tl
+except:
+    WITH_TRITON = False
+    warnings.warn("Triton not installed, fall back to pytorch implements.")
+
+# to make sure cached_property can be loaded for triton
+if WITH_TRITON:
+    try:
+        from functools import cached_property
+    except:
+        warnings.warn("if you are using py37, add this line to functools.py: "
+            "cached_property = lambda func: property(lru_cache()(func))")
+
+# torch implementation ========================================
+def cross_scan_fwd(x: torch.Tensor, in_channel_first=True, out_channel_first=True, scans=0):
+    if in_channel_first:
+        B, C, H, W = x.shape
+        if scans == 0:
+            y = x.new_empty((B, 4, C, H * W))
+            y[:, 0, :, :] = x.flatten(2, 3)
+            y[:, 1, :, :] = x.transpose(dim0=2, dim1=3).flatten(2, 3)
+            y[:, 2:4, :, :] = torch.flip(y[:, 0:2, :, :], dims=[-1])
+        elif scans == 1:
+            y = x.view(B, 1, C, H * W).repeat(1, 4, 1, 1)
+        elif scans == 2:
+            y = x.view(B, 1, C, H * W).repeat(1, 2, 1, 1)
+            y = torch.cat([y, y.flip(dims=[-1])], dim=1)
+        elif scans == 3:
+            y = x.new_empty((B, 4, C, H * W))
+            y[:, 0, :, :] = x.flatten(2, 3)
+            y[:, 1, :, :] = torch.rot90(x, 1, dims=(2, 3)).flatten(2, 3)
+            y[:, 2, :, :] = torch.rot90(x, 2, dims=(2, 3)).flatten(2, 3)
+            y[:, 3, :, :] = torch.rot90(x, 3, dims=(2, 3)).flatten(2, 3)
+    else:
+        B, H, W, C = x.shape
+        if scans == 0:
+            y = x.new_empty((B, H * W, 4, C))
+            y[:, :, 0, :] = x.flatten(1, 2)
+            y[:, :, 1, :] = x.transpose(dim0=1, dim1=2).flatten(1, 2)
+            y[:, :, 2:4, :] = torch.flip(y[:, :, 0:2, :], dims=[1])
+        elif scans == 1:
+            y = x.view(B, H * W, 1, C).repeat(1, 1, 4, 1)
+        elif scans == 2:
+            y = x.view(B, H * W, 1, C).repeat(1, 1, 2, 1)
+            y = torch.cat([y, y.flip(dims=[1])], dim=2)
+        elif scans == 3:
+            y = x.new_empty((B, H * W, 4, C))
+            y[:, :, 0, :] = x.flatten(1, 2)
+            y[:, :, 1, :] = torch.rot90(x, 1, dims=(1, 2)).flatten(1, 2)
+            y[:, :, 2, :] = torch.rot90(x, 2, dims=(1, 2)).flatten(1, 2)
+            y[:, :, 3, :] = torch.rot90(x, 3, dims=(1, 2)).flatten(1, 2)
+
+    if in_channel_first and (not out_channel_first):
+        y = y.permute(0, 3, 1, 2).contiguous()
+    elif (not in_channel_first) and out_channel_first:
+        y = y.permute(0, 2, 3, 1).contiguous()
+
+    return y
+
+
+def cross_merge_fwd(y: torch.Tensor, in_channel_first=True, out_channel_first=True, scans=0):
+    if out_channel_first:
+        B, K, D, H, W = y.shape
+        y = y.view(B, K, D, -1)
+        if scans == 0:
+            y = y[:, 0:2] + y[:, 2:4].flip(dims=[-1]).view(B, 2, D, -1)
+            y = y[:, 0] + y[:, 1].view(B, -1, W, H).transpose(dim0=2, dim1=3).contiguous().view(B, D, -1)
+        elif scans == 1:
+            y = y.sum(1)
+        elif scans == 2:
+            y = y[:, 0:2] + y[:, 2:4].flip(dims=[-1]).view(B, 2, D, -1)
+            y = y.sum(1)
+        elif scans == 3:
+            oy = y[:, 0, :, :].contiguous().view(B, D, -1)
+            oy = oy + torch.rot90(y.view(B, K, D, W, H)[:, 1, :, :, :], -1, dims=(2, 3)).flatten(2, 3)
+            oy = oy + torch.rot90(y.view(B, K, D, H, W)[:, 2, :, :, :], -2, dims=(2, 3)).flatten(2, 3)
+            oy = oy + torch.rot90(y.view(B, K, D, W, H)[:, 3, :, :, :], -3, dims=(2, 3)).flatten(2, 3)
+            y = oy
+    else:
+        B, H, W, K, D = y.shape
+        y = y.view(B, -1, K, D)
+        if scans == 0:
+            y = y[:, :, 0:2] + y[:, :, 2:4].flip(dims=[1]).view(B, -1, 2, D)
+            y = y[:, :, 0] + y[:, :, 1].view(B, W, H, -1).transpose(dim0=1, dim1=2).contiguous().view(B, -1, D)        
+        elif scans == 1:
+            y = y.sum(2)
+        elif scans == 2:
+            y = y[:, :, 0:2] + y[:, :, 2:4].flip(dims=[1]).view(B, -1, 2, D)
+            y = y.sum(2)
+        elif scans == 3:
+            oy = y[:, :, 0, :].contiguous().view(B, -1, D)
+            oy = oy + torch.rot90(y.view(B, W, H, K, D)[:, :, :, 1, :], -1, dims=(1, 2)).flatten(1, 2)
+            oy = oy + torch.rot90(y.view(B, H, W, K, D)[:, :, :, 2, :], -2, dims=(1, 2)).flatten(1, 2)
+            oy = oy + torch.rot90(y.view(B, W, H, K, D)[:, :, :, 3, :], -3, dims=(1, 2)).flatten(1, 2)
+            y = oy
+            
+    if in_channel_first and (not out_channel_first):
+        y = y.permute(0, 2, 1).contiguous()
+    elif (not in_channel_first) and out_channel_first:
+        y = y.permute(0, 2, 1).contiguous()
+    
+    return y
+
+
+def cross_scan1b1_fwd(x: torch.Tensor, in_channel_first=True, out_channel_first=True, scans=0):
+    if in_channel_first:
+        B, _, C, H, W = x.shape
+        if scans == 0:
+            y = torch.stack([
+                x[:, 0].flatten(2, 3),
+                x[:, 1].transpose(dim0=2, dim1=3).flatten(2, 3),
+                torch.flip(x[:, 2].flatten(2, 3), dims=[-1]),
+                torch.flip(x[:, 3].transpose(dim0=2, dim1=3).flatten(2, 3), dims=[-1]),
+            ], dim=1)
+        elif scans == 1:
+            y = x.flatten(2, 3)
+        elif scans == 2:
+            y = torch.stack([
+                x[:, 0].flatten(2, 3),
+                x[:, 1].flatten(2, 3),
+                torch.flip(x[:, 2].flatten(2, 3), dims=[-1]),
+                torch.flip(x[:, 3].flatten(2, 3), dims=[-1]),
+            ], dim=1)
+        elif scans == 3:
+            y = torch.stack([
+                x[:, 0, :, :, :].flatten(2, 3),
+                torch.rot90(x[:, 1, :, :, :], 1, dims=(2, 3)).flatten(2, 3),
+                torch.rot90(x[:, 2, :, :, :], 2, dims=(2, 3)).flatten(2, 3),
+                torch.rot90(x[:, 3, :, :, :], 3, dims=(2, 3)).flatten(2, 3),
+            ], dim=1)
+
+    else:
+        B, H, W, _, C = x.shape
+        if scans == 0:
+            y = torch.stack([
+                x[:, :, :, 0].flatten(1, 2),
+                x[:, :, :, 1].transpose(dim0=1, dim1=2).flatten(1, 2),
+                torch.flip(x[:, :, :, 2].flatten(1, 2), dims=[1]),
+                torch.flip(x[:, :, :, 3].transpose(dim0=1, dim1=2).flatten(1, 2), dims=[1]),
+            ], dim=2)
+        elif scans == 1:
+            y = x.flatten(1, 2)
+        elif scans == 2:
+            y = torch.stack([
+                x[:, 0].flatten(1, 2),
+                x[:, 1].flatten(1, 2),
+                torch.flip(x[:, 2].flatten(1, 2), dims=[-1]),
+                torch.flip(x[:, 3].flatten(1, 2), dims=[-1]),
+            ], dim=2)
+        elif scans == 3:
+            y = torch.stack([
+                x[:, :, :, 0, :].flatten(1, 2),
+                torch.rot90(x[:, :, :, 1, :], 1, dims=(1, 2)).flatten(1, 2),
+                torch.rot90(x[:, :, :, 2, :], 2, dims=(1, 2)).flatten(1, 2),
+                torch.rot90(x[:, :, :, 3, :], 3, dims=(1, 2)).flatten(1, 2),
+            ], dim=1)
+
+    if in_channel_first and (not out_channel_first):
+        y = y.permute(0, 3, 1, 2).contiguous()
+    elif (not in_channel_first) and out_channel_first:
+        y = y.permute(0, 2, 3, 1).contiguous()
+
+    return y
+
+
+def cross_merge1b1_fwd(y: torch.Tensor, in_channel_first=True, out_channel_first=True, scans=0):
+    if out_channel_first:
+        B, K, D, H, W = y.shape
+        y = y.view(B, K, D, -1)
+        if scans == 0:
+            y = torch.stack([
+                y[:, 0],
+                y[:, 1].view(B, -1, W, H).transpose(dim0=2, dim1=3).flatten(2, 3),
+                torch.flip(y[:, 2], dims=[-1]),
+                torch.flip(y[:, 3].view(B, -1, W, H).transpose(dim0=2, dim1=3).flatten(2, 3), dims=[-1]),
+            ], dim=1)
+        elif scans == 1:
+            y = y
+        elif scans == 2:
+            y = torch.stack([
+                y[:, 0],
+                y[:, 1],
+                torch.flip(y[:, 2], dims=[-1]),
+                torch.flip(y[:, 3], dims=[-1]),
+            ], dim=1)
+        elif scans == 3:
+            y = torch.stack([
+                y[:, 0, :, :].contiguous().view(B, D, -1),
+                torch.rot90(y.view(B, K, D, W, H)[:, 1, :, :, :], -1, dims=(2, 3)).flatten(2, 3),
+                torch.rot90(y.view(B, K, D, H, W)[:, 2, :, :, :], -2, dims=(2, 3)).flatten(2, 3),
+                torch.rot90(y.view(B, K, D, W, H)[:, 3, :, :, :], -3, dims=(2, 3)).flatten(2, 3),
+            ], dim=1)
+    else:
+        B, H, W, K, D = y.shape
+        y = y.view(B, -1, K, D)
+        if scans == 0:
+            y = torch.stack([
+                y[:, :, 0],
+                y[:, :, 1].view(B, W, H, -1).transpose(dim0=1, dim1=2).flatten(1, 2),
+                torch.flip(y[:, :, 2], dims=[1]),
+                torch.flip(y[:, :, 3].view(B, W, H, -1).transpose(dim0=1, dim1=2).flatten(1, 2), dims=[1]),
+            ], dim=2)
+        elif scans == 1:
+            y = y
+        elif scans == 2:
+            y = torch.stack([
+                y[:, :, 0],
+                y[:, :, 1],
+                torch.flip(y[:, :, 2], dims=[1]),
+                torch.flip(y[:, :, 3], dims=[1]),
+            ], dim=2)
+        elif scans == 3:
+            y = torch.stack([
+                y[:, :, 0, :].contiguous().view(B, -1, D),
+                torch.rot90(y.view(B, W, H, K, D)[:, :, :, 1, :], -1, dims=(1, 2)).flatten(1, 2),
+                torch.rot90(y.view(B, H, W, K, D)[:, :, :, 2, :], -2, dims=(1, 2)).flatten(1, 2),
+                torch.rot90(y.view(B, W, H, K, D)[:, :, :, 3, :], -3, dims=(1, 2)).flatten(1, 2),
+            ], dim=2)
+
+    if out_channel_first and (not in_channel_first):
+        y = y.permute(0, 3, 1, 2).contiguous()
+    elif (not out_channel_first) and in_channel_first:
+        y = y.permute(0, 2, 3, 1).contiguous()
+
+    return y
+
+
+class CrossScanF(torch.autograd.Function):
+    @staticmethod
+    def forward(ctx, x: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0):
+        # x: (B, C, H, W) | (B, H, W, C) | (B, 4, C, H, W) | (B, H, W, 4, C)
+        # y: (B, 4, C, H * W) | (B, H * W, 4, C)
+        ctx.in_channel_first = in_channel_first
+        ctx.out_channel_first = out_channel_first
+        ctx.one_by_one = one_by_one
+        ctx.scans = scans
+
+        if one_by_one:
+            B, K, C, H, W = x.shape
+            if not in_channel_first:
+                B, H, W, K, C = x.shape
+        else:
+            B, C, H, W = x.shape
+            if not in_channel_first:
+                B, H, W, C = x.shape
+        ctx.shape = (B, C, H, W)
+
+        _fn = cross_scan1b1_fwd if one_by_one else cross_scan_fwd
+        y = _fn(x, in_channel_first, out_channel_first, scans)
+
+        return y
+    
+    @staticmethod
+    def backward(ctx, ys: torch.Tensor):
+        # out: (b, k, d, l)
+        in_channel_first = ctx.in_channel_first
+        out_channel_first = ctx.out_channel_first
+        one_by_one = ctx.one_by_one
+        scans = ctx.scans
+        B, C, H, W = ctx.shape
+
+        ys = ys.view(B, -1, C, H, W) if out_channel_first else ys.view(B, H, W, -1, C)
+        _fn = cross_merge1b1_fwd if one_by_one else cross_merge_fwd
+        y = _fn(ys, in_channel_first, out_channel_first, scans)
+        
+        if one_by_one:
+            y = y.view(B, 4, -1, H, W) if in_channel_first else y.view(B, H, W, 4, -1)
+        else:
+            y = y.view(B, -1, H, W) if in_channel_first else y.view(B, H, W, -1)
+
+        return y, None, None, None, None
+
+
+class CrossMergeF(torch.autograd.Function):
+    @staticmethod
+    def forward(ctx, ys: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0):
+        # x: (B, C, H, W) | (B, H, W, C) | (B, 4, C, H, W) | (B, H, W, 4, C)
+        # y: (B, 4, C, H * W) | (B, H * W, 4, C)
+        ctx.in_channel_first = in_channel_first
+        ctx.out_channel_first = out_channel_first
+        ctx.one_by_one = one_by_one
+        ctx.scans = scans
+
+        B, K, C, H, W = ys.shape
+        if not out_channel_first:
+            B, H, W, K, C = ys.shape
+        ctx.shape = (B, C, H, W)
+        
+        _fn = cross_merge1b1_fwd if one_by_one else cross_merge_fwd
+        y = _fn(ys, in_channel_first, out_channel_first, scans)
+
+        return y
+    
+    @staticmethod
+    def backward(ctx, x: torch.Tensor):
+        # B, D, L = x.shape
+        # out: (b, k, d, h, w)
+        in_channel_first = ctx.in_channel_first
+        out_channel_first = ctx.out_channel_first
+        one_by_one = ctx.one_by_one
+        scans = ctx.scans
+        B, C, H, W = ctx.shape
+    
+        if not one_by_one:
+            if in_channel_first:
+                x = x.view(B, C, H, W)
+            else:
+                x = x.view(B, H, W, C)
+        else:
+            if in_channel_first:
+                x = x.view(B, 4, C, H, W)
+            else:
+                x = x.view(B, H, W, 4, C)   
+                     
+        _fn = cross_scan1b1_fwd if one_by_one else cross_scan_fwd
+        x = _fn(x, in_channel_first, out_channel_first, scans)
+        x = x.view(B, 4, C, H, W) if out_channel_first else x.view(B, H, W, 4, C)
+    
+        return x, None, None, None, None
+
+
+# triton implements ========================================
+
+@triton.jit
+def triton_cross_scan_flex(
+    x: tl.tensor, # (B, C, H, W) | (B, H, W, C) | (B, 4, C, H, W) | (B, H, W, 4, C)
+    y: tl.tensor, # (B, 4, C, H, W) | (B, H, W, 4, C)
+    x_layout: tl.constexpr,
+    y_layout: tl.constexpr,
+    operation: tl.constexpr,
+    onebyone: tl.constexpr,
+    scans: tl.constexpr,
+    BC: tl.constexpr,
+    BH: tl.constexpr,
+    BW: tl.constexpr,
+    DC: tl.constexpr,
+    DH: tl.constexpr,
+    DW: tl.constexpr,
+    NH: tl.constexpr,
+    NW: tl.constexpr,
+):
+    # x_layout = 0
+    # y_layout = 1 # 0 BCHW, 1 BHWC
+    # operation = 0 # 0 scan, 1 merge
+    # onebyone = 0 # 0 false, 1 true
+    # scans = 0 # 0 cross scan, 1 unidirectional, 2 bidirectional
+
+    i_hw, i_c, i_b = tl.program_id(0), tl.program_id(1), tl.program_id(2)
+    i_h, i_w = (i_hw // NW), (i_hw % NW)
+    _mask_h = (i_h * BH + tl.arange(0, BH)) < DH
+    _mask_w = (i_w * BW + tl.arange(0, BW)) < DW
+    _mask_hw = _mask_h[:, None] & _mask_w[None, :]
+    _for_C = min(DC - i_c * BC, BC)
+
+    pos_h = (i_h * BH + tl.arange(0, BH)[:, None])
+    pos_w = (i_w * BW + tl.arange(0, BW)[None, :])
+    neg_h = (DH - i_h * BH - 1 - tl.arange(0, BH)[:, None])
+    neg_w = (DW - i_w * BW - 1 - tl.arange(0, BW)[None, :])
+    if scans == 0:
+        # none; trans; flip; trans + flip;
+        HWRoute0 = pos_h * DW + pos_w
+        HWRoute1 = pos_w * DH + pos_h # trans
+        HWRoute2 = neg_h * DW + neg_w # flip
+        HWRoute3 = neg_w * DH + neg_h # trans + flip
+    elif scans == 1:
+        # none; none; none; none;
+        HWRoute0 = pos_h * DW + pos_w
+        HWRoute1 = HWRoute0
+        HWRoute2 = HWRoute0
+        HWRoute3 = HWRoute0
+    elif scans == 2:
+        # none; none; flip; flip;
+        HWRoute0 = pos_h * DW + pos_w
+        HWRoute1 = HWRoute0
+        HWRoute2 = neg_h * DW + neg_w # flip
+        HWRoute3 = HWRoute2 
+    elif scans == 3:
+        # none; rot90; rot180==flip; rot270;
+        HWRoute0 = pos_h * DW + pos_w
+        HWRoute1 = neg_w * DH + pos_h
+        HWRoute2 = neg_h * DW + neg_w
+        HWRoute3 = pos_w * DH + neg_h
+
+    _tmp1 = DC * DH * DW
+
+    y_ptr_base = y + i_b * 4 * _tmp1 + (i_c * BC * DH * DW if y_layout == 0 else i_c * BC)
+    if y_layout == 0:
+        p_y1 = y_ptr_base + HWRoute0
+        p_y2 = y_ptr_base + _tmp1 + HWRoute1
+        p_y3 = y_ptr_base + 2 * _tmp1 + HWRoute2
+        p_y4 = y_ptr_base + 3 * _tmp1 + HWRoute3
+    else:
+        p_y1 = y_ptr_base + HWRoute0 * 4 * DC
+        p_y2 = y_ptr_base + DC + HWRoute1 * 4 * DC
+        p_y3 = y_ptr_base + 2 * DC + HWRoute2 * 4 * DC
+        p_y4 = y_ptr_base + 3 * DC + HWRoute3 * 4 * DC       
+    
+    if onebyone == 0:
+        x_ptr_base = x + i_b * _tmp1 + (i_c * BC * DH * DW if x_layout == 0 else i_c * BC)
+        if x_layout == 0:
+            p_x = x_ptr_base + HWRoute0
+        else:
+            p_x = x_ptr_base + HWRoute0 * DC
+
+        if operation == 0:
+            for idxc in range(_for_C):
+                _idx_x = idxc * DH * DW if x_layout == 0 else idxc
+                _idx_y = idxc * DH * DW if y_layout == 0 else idxc
+                _x = tl.load(p_x + _idx_x, mask=_mask_hw)
+                tl.store(p_y1 + _idx_y, _x, mask=_mask_hw)
+                tl.store(p_y2 + _idx_y, _x, mask=_mask_hw)
+                tl.store(p_y3 + _idx_y, _x, mask=_mask_hw)
+                tl.store(p_y4 + _idx_y, _x, mask=_mask_hw)
+        elif operation == 1:
+            for idxc in range(_for_C):
+                _idx_x = idxc * DH * DW if x_layout == 0 else idxc
+                _idx_y = idxc * DH * DW if y_layout == 0 else idxc
+                _y1 = tl.load(p_y1 + _idx_y, mask=_mask_hw)
+                _y2 = tl.load(p_y2 + _idx_y, mask=_mask_hw)
+                _y3 = tl.load(p_y3 + _idx_y, mask=_mask_hw)
+                _y4 = tl.load(p_y4 + _idx_y, mask=_mask_hw)
+                tl.store(p_x + _idx_x, _y1 + _y2 + _y3 + _y4, mask=_mask_hw)
+
+    else:
+        x_ptr_base = x + i_b * 4 * _tmp1 + (i_c * BC * DH * DW if x_layout == 0 else i_c * BC)
+        if x_layout == 0:
+            p_x1 = x_ptr_base + HWRoute0
+            p_x2 = p_x1 + _tmp1
+            p_x3 = p_x2 + _tmp1
+            p_x4 = p_x3 + _tmp1  
+        else:
+            p_x1 = x_ptr_base + HWRoute0 * 4 * DC
+            p_x2 = p_x1 + DC
+            p_x3 = p_x2 + DC
+            p_x4 = p_x3 + DC        
+    
+        if operation == 0:
+            for idxc in range(_for_C):
+                _idx_x = idxc * DH * DW if x_layout == 0 else idxc
+                _idx_y = idxc * DH * DW if y_layout == 0 else idxc
+                tl.store(p_y1 + _idx_y, tl.load(p_x1 + _idx_x, mask=_mask_hw), mask=_mask_hw)
+                tl.store(p_y2 + _idx_y, tl.load(p_x2 + _idx_x, mask=_mask_hw), mask=_mask_hw)
+                tl.store(p_y3 + _idx_y, tl.load(p_x3 + _idx_x, mask=_mask_hw), mask=_mask_hw)
+                tl.store(p_y4 + _idx_y, tl.load(p_x4 + _idx_x, mask=_mask_hw), mask=_mask_hw)
+        else:
+            for idxc in range(_for_C):
+                _idx_x = idxc * DH * DW if x_layout == 0 else idxc
+                _idx_y = idxc * DH * DW if y_layout == 0 else idxc
+                tl.store(p_x1 + _idx_x, tl.load(p_y1 + _idx_y), mask=_mask_hw)
+                tl.store(p_x2 + _idx_x, tl.load(p_y2 + _idx_y), mask=_mask_hw)
+                tl.store(p_x3 + _idx_x, tl.load(p_y3 + _idx_y), mask=_mask_hw)
+                tl.store(p_x4 + _idx_x, tl.load(p_y4 + _idx_y), mask=_mask_hw)
+
+
+class CrossScanTritonF(torch.autograd.Function):
+    @staticmethod
+    def forward(ctx, x: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0):
+        if one_by_one:
+            if in_channel_first:
+                B, _, C, H, W = x.shape
+            else:
+                B, H, W, _, C = x.shape
+        else:
+            if in_channel_first:
+                B, C, H, W = x.shape
+            else:
+                B, H, W, C = x.shape
+        B, C, H, W = int(B), int(C), int(H), int(W)
+        BC, BH, BW = 1, 32, 32
+        NH, NW, NC = triton.cdiv(H, BH), triton.cdiv(W, BW), triton.cdiv(C, BC)
+        
+        ctx.in_channel_first = in_channel_first
+        ctx.out_channel_first = out_channel_first
+        ctx.one_by_one = one_by_one
+        ctx.scans = scans
+        ctx.shape = (B, C, H, W)
+        ctx.triton_shape = (BC, BH, BW, NC, NH, NW)
+
+        y = x.new_empty((B, 4, C, H * W)) if out_channel_first else x.new_empty((B, H * W, 4, C))
+        triton_cross_scan_flex[(NH * NW, NC, B)](
+            x.contiguous(), y, 
+            (0 if in_channel_first else 1), (0 if out_channel_first else 1), 0, (0 if not one_by_one else 1), scans, 
+            BC, BH, BW, C, H, W, NH, NW
+        )
+        return y
+        
+    @staticmethod
+    def backward(ctx, y: torch.Tensor):
+        in_channel_first = ctx.in_channel_first
+        out_channel_first = ctx.out_channel_first
+        one_by_one = ctx.one_by_one
+        scans = ctx.scans
+        B, C, H, W = ctx.shape
+        BC, BH, BW, NC, NH, NW = ctx.triton_shape
+        if one_by_one:
+            x = y.new_empty((B, 4, C, H, W)) if in_channel_first else y.new_empty((B, H, W, 4, C))
+        else:
+            x = y.new_empty((B, C, H, W)) if in_channel_first else y.new_empty((B, H, W, C))
+        
+        triton_cross_scan_flex[(NH * NW, NC, B)](
+            x, y.contiguous(), 
+            (0 if in_channel_first else 1), (0 if out_channel_first else 1), 1, (0 if not one_by_one else 1), scans,
+            BC, BH, BW, C, H, W, NH, NW
+        )
+        return x, None, None, None, None
+
+
+class CrossMergeTritonF(torch.autograd.Function):
+    @staticmethod
+    def forward(ctx, y: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0):
+        if out_channel_first:
+            B, _, C, H, W = y.shape
+        else:
+            B, H, W, _, C = y.shape
+        B, C, H, W = int(B), int(C), int(H), int(W)
+        BC, BH, BW = 1, 32, 32
+        NH, NW, NC = triton.cdiv(H, BH), triton.cdiv(W, BW), triton.cdiv(C, BC)
+        ctx.in_channel_first = in_channel_first
+        ctx.out_channel_first = out_channel_first
+        ctx.one_by_one = one_by_one
+        ctx.scans = scans
+        ctx.shape = (B, C, H, W)
+        ctx.triton_shape = (BC, BH, BW, NC, NH, NW)
+        if one_by_one:
+            x = y.new_empty((B, 4, C, H * W)) if in_channel_first else y.new_empty((B, H * W, 4, C))
+        else:
+            x = y.new_empty((B, C, H * W)) if in_channel_first else y.new_empty((B, H * W, C))
+        triton_cross_scan_flex[(NH * NW, NC, B)](
+            x, y.contiguous(), 
+            (0 if in_channel_first else 1), (0 if out_channel_first else 1), 1, (0 if not one_by_one else 1), scans,
+            BC, BH, BW, C, H, W, NH, NW
+        )
+        return x
+        
+    @staticmethod
+    def backward(ctx, x: torch.Tensor):
+        in_channel_first = ctx.in_channel_first
+        out_channel_first = ctx.out_channel_first
+        one_by_one = ctx.one_by_one
+        scans = ctx.scans
+        B, C, H, W = ctx.shape
+        BC, BH, BW, NC, NH, NW = ctx.triton_shape
+        y = x.new_empty((B, 4, C, H, W)) if out_channel_first else x.new_empty((B, H, W, 4, C))
+        triton_cross_scan_flex[(NH * NW, NC, B)](
+            x.contiguous(), y, 
+            (0 if in_channel_first else 1), (0 if out_channel_first else 1), 0, (0 if not one_by_one else 1), scans,
+            BC, BH, BW, C, H, W, NH, NW
+        )
+        return y, None, None, None, None, None
+
+
+# @torch.compile(options={"triton.cudagraphs": True}, fullgraph=True)
+def cross_scan_fn(x: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0, force_torch=False):
+    # x: (B, C, H, W) | (B, H, W, C) | (B, 4, C, H, W) | (B, H, W, 4, C)
+    # y: (B, 4, C, L) | (B, L, 4, C)
+    # scans: 0: cross scan; 1 unidirectional; 2: bidirectional;
+    CSF = CrossScanTritonF if WITH_TRITON and x.is_cuda and (not force_torch) else CrossScanF
+    if x.is_cuda:
+        with torch.cuda.device(x.device):
+            return CSF.apply(x, in_channel_first, out_channel_first, one_by_one, scans)
+    else:
+        return CrossScanF.apply(x, in_channel_first, out_channel_first, one_by_one, scans)
+
+
+# @torch.compile(options={"triton.cudagraphs": True}, fullgraph=True)
+def cross_merge_fn(y: torch.Tensor, in_channel_first=True, out_channel_first=True, one_by_one=False, scans=0, force_torch=False):
+    # y: (B, 4, C, L) | (B, L, 4, C)
+    # x: (B, C, H * W) | (B, H * W, C) | (B, 4, C, H * W) | (B, H * W, 4, C)
+    # scans: 0: cross scan; 1 unidirectional; 2: bidirectional;
+    CMF = CrossMergeTritonF if WITH_TRITON and y.is_cuda and (not force_torch) else CrossMergeF
+    if y.is_cuda:
+        with torch.cuda.device(y.device):
+            return CMF.apply(y, in_channel_first, out_channel_first, one_by_one, scans)
+    else:
+        return CrossMergeF.apply(y, in_channel_first, out_channel_first, one_by_one, scans)
+
+
+##########################################################
+# csms6s.py
+##########################################################
+
+WITH_SELECTIVESCAN_MAMBA = True
+try:
+    import selective_scan_cuda
+except ImportError:
+    WITH_SELECTIVESCAN_MAMBA = False
+
+
+def selective_scan_torch(
+    u: torch.Tensor, # (B, K * C, L)
+    delta: torch.Tensor, # (B, K * C, L)
+    A: torch.Tensor, # (K * C, N)
+    B: torch.Tensor, # (B, K, N, L)
+    C: torch.Tensor, # (B, K, N, L)
+    D: torch.Tensor = None, # (K * C)
+    delta_bias: torch.Tensor = None, # (K * C)
+    delta_softplus=True, 
+    oflex=True, 
+    *args,
+    **kwargs
+):
+    dtype_in = u.dtype
+    Batch, K, N, L = B.shape
+    KCdim = u.shape[1]
+    Cdim = int(KCdim / K)
+    assert u.shape == (Batch, KCdim, L)
+    assert delta.shape == (Batch, KCdim, L)
+    assert A.shape == (KCdim, N)
+    assert C.shape == B.shape
+
+    if delta_bias is not None:
+        delta = delta + delta_bias[..., None]
+    if delta_softplus:
+        delta = torch.nn.functional.softplus(delta)
+            
+    u, delta, A, B, C = u.float(), delta.float(), A.float(), B.float(), C.float()
+    B = B.view(Batch, K, 1, N, L).repeat(1, 1, Cdim, 1, 1).view(Batch, KCdim, N, L)
+    C = C.view(Batch, K, 1, N, L).repeat(1, 1, Cdim, 1, 1).view(Batch, KCdim, N, L)
+    deltaA = torch.exp(torch.einsum('bdl,dn->bdln', delta, A))
+    deltaB_u = torch.einsum('bdl,bdnl,bdl->bdln', delta, B, u)
+    
+    if True:
+        x = A.new_zeros((Batch, KCdim, N))
+        ys = []
+        for i in range(L):
+            x = deltaA[:, :, i, :] * x + deltaB_u[:, :, i, :]
+            y = torch.einsum('bdn,bdn->bd', x, C[:, :, :, i])
+            ys.append(y)
+        y = torch.stack(ys, dim=2) # (B, C, L)
+    
+    out = y if D is None else y + u * D.unsqueeze(-1)
+    return out if oflex else out.to(dtype=dtype_in)
+
+
+class SelectiveScanCuda(torch.autograd.Function):
+    @staticmethod
+    @torch.cuda.amp.custom_fwd
+    def forward(ctx, u, delta, A, B, C, D=None, delta_bias=None, delta_softplus=False, oflex=True, backend=None):
+        ctx.delta_softplus = delta_softplus
+        # backend = "oflex" if WITH_SELECTIVESCAN_OFLEX and (backend is None) else backend
+        # backend = "core" if WITH_SELECTIVESCAN_CORE and (backend is None) else backend
+        backend = "mamba" if WITH_SELECTIVESCAN_MAMBA and (backend is None) else backend
+        ctx.backend = backend
+        if backend == "oflex":
+            out, x, *rest = selective_scan_cuda_oflex.fwd(u, delta, A, B, C, D, delta_bias, delta_softplus, 1, oflex)
+        elif backend == "mamba":
+            out, x, *rest = selective_scan_cuda.fwd(u, delta, A, B, C, D, None, delta_bias, delta_softplus)
+        ctx.save_for_backward(u, delta, A, B, C, D, delta_bias, x)
+        return out
+    
+    @staticmethod
+    @torch.cuda.amp.custom_bwd
+    def backward(ctx, dout, *args):
+        u, delta, A, B, C, D, delta_bias, x = ctx.saved_tensors
+        backend = ctx.backend
+        if dout.stride(-1) != 1:
+            dout = dout.contiguous()
+        if backend == "oflex":
+            du, ddelta, dA, dB, dC, dD, ddelta_bias, *rest = selective_scan_cuda_oflex.bwd(
+                u, delta, A, B, C, D, delta_bias, dout, x, ctx.delta_softplus, 1
+            )
+        elif backend == "mamba":
+            du, ddelta, dA, dB, dC, dD, ddelta_bias, *rest = selective_scan_cuda.bwd(
+                u, delta, A, B, C, D, None, delta_bias, dout, x, None, None, ctx.delta_softplus,
+                False
+            )
+        return du, ddelta, dA, dB, dC, dD, ddelta_bias, None, None, None
+
+
+def selective_scan_fn(
+    u: torch.Tensor, # (B, K * C, L)
+    delta: torch.Tensor, # (B, K * C, L)
+    A: torch.Tensor, # (K * C, N)
+    B: torch.Tensor, # (B, K, N, L)
+    C: torch.Tensor, # (B, K, N, L)
+    D: torch.Tensor = None, # (K * C)
+    delta_bias: torch.Tensor = None, # (K * C)
+    delta_softplus=True, 
+    oflex=True,
+    backend=None,
+):
+    fn = selective_scan_torch if backend == "torch" or (not WITH_SELECTIVESCAN_MAMBA) else SelectiveScanCuda.apply
+    return fn(u, delta, A, B, C, D, delta_bias, delta_softplus, oflex, backend)
+
+##########################################################
+############## HuggingFace modeling file #################
+##########################################################
+
+class VMambaLinear2d(nn.Linear):
+    def __init__(self, *args, groups=1, **kwargs):
+        nn.Linear.__init__(self, *args, **kwargs)
+        self.groups = groups
+    
+    def forward(self, x: torch.Tensor):
+        if len(x.shape) == 4:
+            return F.conv2d(x, self.weight[:, :, None, None], self.bias, groups=self.groups)
+        elif len(x.shape) == 3:
+            return F.conv1d(x, self.weight[:, :, None], self.bias, groups=self.groups)
+
+    def _load_from_state_dict(self, state_dict, prefix, local_metadata, strict, missing_keys, unexpected_keys, error_msgs):
+        self_state_dict = self.state_dict()
+        load_state_dict_keys = list(state_dict.keys())
+        if prefix + "weight" in load_state_dict_keys:
+            state_dict[prefix + "weight"] = state_dict[prefix + "weight"].view_as(self_state_dict["weight"])
+        return super()._load_from_state_dict(state_dict, prefix, local_metadata, strict, missing_keys, unexpected_keys, error_msgs)
+
+
+class VMambaLayerNorm2d(nn.LayerNorm):
+    def __init__(self, *args, **kwargs):
+        nn.LayerNorm.__init__(self, *args, **kwargs)
+
+    def forward(self, x: torch.Tensor):
+        x = x.permute(0, 2, 3, 1)
+        x = nn.LayerNorm.forward(self, x)
+        x = x.permute(0, 3, 1, 2)
+        return x
+
+
+class VMambaPatchEmbeddings(nn.Module):
+    """
+    This class turns `input_values` into the initial `hidden_states` (patch embeddings) of shape `(batch_size,
+    seq_length, hidden_size)` to be consumed by a State-space model.
+    """
+
+    def __init__(self, num_channels=3,patch_size=4,embed_dim=96):
+        super().__init__()
+
+        stride = patch_size // 2
+        kernel_size = stride + 1
+        padding = 1
+
+        self.projection = nn.Sequential(
+            nn.Conv2d(num_channels, embed_dim // 2, kernel_size=kernel_size, stride=stride, padding=padding),
+            VMambaLayerNorm2d(embed_dim // 2),
+            nn.GELU(),
+            nn.Conv2d(embed_dim // 2, embed_dim, kernel_size=kernel_size, stride=stride, padding=padding),
+            VMambaLayerNorm2d(embed_dim),
+        )
+
+    def forward(self, x: torch.Tensor) -> torch.Tensor:
+        x = self.projection(x)
+        return x
+
+
+class VMambaDowsample(nn.Module):
+    """
+    This class downsamples the input tensor using a convolutional layer followed by a layer normalization.
+    """
+    def __init__(self, dim, out_dim, use_norm=True):
+        super().__init__()
+        self.down = nn.Conv2d(dim, out_dim, kernel_size=3, stride=2, padding=1)
+        self.norm = VMambaLayerNorm2d(out_dim) if use_norm else nn.Identity()
+
+    def forward(self, x):
+        x = self.down(x)
+        x = self.norm(x)
+        return x
+
+
+class VMambaMlp(nn.Module):
+    def __init__(self, in_features, hidden_features=None, out_features=None, act_layer=nn.GELU, drop=0.):
+        super().__init__()
+        out_features = out_features or in_features
+        hidden_features = hidden_features or in_features
+        self.fc1 = VMambaLinear2d(in_features, hidden_features)
+        self.act = act_layer()
+        self.fc2 = VMambaLinear2d(hidden_features, out_features)
+        self.drop = nn.Dropout(drop)
+
+    def forward(self, x):
+        x = self.fc1(x)
+        x = self.act(x)
+        x = self.drop(x)
+        x = self.fc2(x)
+        x = self.drop(x)
+        return x
+
+
+class SS2D(nn.Module):
+    def __init__(
+        self,
+        # basic dims ===========
+        d_model=96,
+        d_state=16,
+        ssm_ratio=2.0,
+        dt_rank="auto",
+        act_layer=nn.SiLU,
+        # dwconv ===============
+        d_conv=3,
+        conv_bias=True,
+        # ======================
+        dropout=0.0,
+        bias=False,
+        # dt init ==============
+        dt_min=0.001,
+        dt_max=0.1,
+        dt_init="random",
+        dt_scale=1.0,
+        dt_init_floor=1e-4,
+        # forward_type="v05_noz" is always used
+        # ======================
+        **kwargs,
+    ):
+        super().__init__()
+        self.k_group = 4
+        self.d_model = int(d_model)
+        self.d_state = int(d_state)
+        self.d_inner = int(ssm_ratio * d_model)
+        self.dt_rank = int(math.ceil(self.d_model / 16) if dt_rank == "auto" else dt_rank)
+        self.forward_core = partial(self.forward_corev2, force_fp32=False, no_einsum=True)
+        self.with_dconv = d_conv > 1
+
+        # In projection
+        self.in_proj = VMambaLinear2d(self.d_model, self.d_inner, bias=bias)
+        self.act: nn.Module = act_layer()
+
+        # Convolution
+        if self.with_dconv:
+            self.conv2d = nn.Conv2d(
+                in_channels=self.d_inner,
+                out_channels=self.d_inner,
+                groups=self.d_inner,
+                bias=conv_bias,
+                kernel_size=d_conv,
+                padding=(d_conv - 1) // 2,
+            )
+
+        # x_proj and dt_proj
+        self.x_proj = VMambaLinear2d(self.d_inner, self.k_group * (self.dt_rank + self.d_state * 2), groups=self.k_group, bias=False)
+        self.dt_projs = VMambaLinear2d(self.dt_rank, self.k_group * self.d_inner, groups=self.k_group, bias=False)
+
+        # out projection
+        self.out_proj = VMambaLinear2d(self.d_inner, self.d_model, bias=bias)
+        self.dropout = nn.Dropout(dropout) if dropout > 0. else nn.Identity()
+
+        # Initialization
+        self.A_logs, self.Ds, self.dt_projs_weight, self.dt_projs_bias = self.init_dt_A_D(
+            self.d_state, self.dt_rank, self.d_inner, dt_scale, dt_init, dt_min, dt_max, dt_init_floor, k_group=self.k_group,
+        )
+        self.dt_projs.weight.data = self.dt_projs_weight.data.view(self.dt_projs.weight.shape)
+        # self.dt_projs.bias.data = self.dt_projs_bias.data.view(self.dt_projs.bias.shape)
+        del self.dt_projs_weight
+        # del self.dt_projs_bias
+        # Define out_norm directly with "LN2D"
+        self.out_norm = VMambaLayerNorm2d(self.d_inner)
+
+    @staticmethod
+    def dt_init(dt_rank, d_inner, dt_scale=1.0, dt_init="random", dt_min=0.001, dt_max=0.1, dt_init_floor=1e-4):
+        dt_proj = nn.Linear(dt_rank, d_inner, bias=True)
+
+        dt_init_std = dt_rank**-0.5 * dt_scale
+        if dt_init == "constant":
+            nn.init.constant_(dt_proj.weight, dt_init_std)
+        elif dt_init == "random":
+            nn.init.uniform_(dt_proj.weight, -dt_init_std, dt_init_std)
+        else:
+            raise NotImplementedError
+
+        dt = torch.exp(
+            torch.rand(d_inner) * (math.log(dt_max) - math.log(dt_min))
+            + math.log(dt_min)
+        ).clamp(min=dt_init_floor)
+
+        inv_dt = dt + torch.log(-torch.expm1(-dt))
+        with torch.no_grad():
+            dt_proj.bias.copy_(inv_dt)
+        
+        return dt_proj
+
+    @staticmethod
+    def A_log_init(d_state, d_inner, copies=-1, device=None, merge=True):
+        A = torch.arange(1, d_state + 1, dtype=torch.float32, device=device).view(1, -1).repeat(d_inner, 1).contiguous()
+        A_log = torch.log(A)
+        if copies > 0:
+            A_log = A_log[None].repeat(copies, 1, 1).contiguous()
+            if merge:
+                A_log = A_log.flatten(0, 1)
+        A_log = nn.Parameter(A_log)
+        A_log._no_weight_decay = True
+        return A_log
+
+    @staticmethod
+    def D_init(d_inner, copies=-1, device=None, merge=True):
+        D = torch.ones(d_inner, device=device)
+        if copies > 0:
+            D = D[None].repeat(copies, 1).contiguous()
+            if merge:
+                D = D.flatten(0, 1)
+        D = nn.Parameter(D)
+        D._no_weight_decay = True
+        return D
+
+    @classmethod
+    def init_dt_A_D(cls, d_state, dt_rank, d_inner, dt_scale, dt_init, dt_min, dt_max, dt_init_floor, k_group=4):
+        dt_projs = [
+            cls.dt_init(dt_rank, d_inner, dt_scale, dt_init, dt_min, dt_max, dt_init_floor)
+            for _ in range(k_group)
+        ]
+        dt_projs_weight = nn.Parameter(torch.stack([t.weight for t in dt_projs], dim=0))
+        dt_projs_bias = nn.Parameter(torch.stack([t.bias for t in dt_projs], dim=0))
+        del dt_projs
+            
+        A_logs = cls.A_log_init(d_state, d_inner, copies=k_group, merge=True)
+        Ds = cls.D_init(d_inner, copies=k_group, merge=True)
+        return A_logs, Ds, dt_projs_weight, dt_projs_bias
+
+    def forward_corev2(
+        self,
+        x: torch.Tensor,
+        force_fp32=False,
+        no_einsum=True,
+    ):
+        B, D, H, W = x.shape
+        N = self.d_state
+        L = H * W
+
+        xs = cross_scan_fn(x, in_channel_first=True, out_channel_first=True)
+        x_dbl = self.x_proj(xs.view(B, -1, L))
+        dts, Bs, Cs = torch.split(x_dbl.view(B, self.k_group, -1, L), [self.dt_rank, N, N], dim=2)
+        dts = dts.contiguous().view(B, -1, L)
+        dts = self.dt_projs(dts)
+
+        xs = xs.view(B, -1, L)
+        dts = dts.contiguous().view(B, -1, L)
+        As = -self.A_logs.to(torch.float32).exp()
+        Ds = self.Ds.to(torch.float32)
+        Bs = Bs.contiguous().view(B, self.k_group, N, L)
+        Cs = Cs.contiguous().view(B, self.k_group, N, L)
+        delta_bias = self.dt_projs_bias.view(-1).to(torch.float32)
+        
+        ys = selective_scan_fn(
+            xs, dts, As, Bs, Cs, Ds, delta_bias, delta_softplus=True, backend="mamba"
+        ).view(B, self.k_group, -1, H, W)
+        
+        y = cross_merge_fn(ys, in_channel_first=True, out_channel_first=True)
+        y = y.view(B, -1, H, W)
+        y = self.out_norm(y)
+        return y.to(x.dtype)
+
+    def forward(self, x: torch.Tensor):
+        x = self.in_proj(x)
+        x = self.conv2d(x)
+            
+        x = self.act(x)
+        y = self.forward_core(x)
+        
+        out = self.dropout(self.out_proj(y))
+        return out
+
+
+class VSSBlock(nn.Module):
+    def __init__(
+        self,
+        hidden_dim: int = 0,
+        drop_path: float = 0,
+        ssm_d_state: int = 1,
+        ssm_ratio=1.0,
+        ssm_dt_rank: Any = "auto",
+        ssm_act_layer=nn.SiLU,
+        ssm_conv: int = 3,
+        ssm_conv_bias=False,
+        ssm_drop_rate: float = 0,
+        mlp_ratio=4.0,
+        mlp_act_layer=nn.GELU,
+        mlp_drop_rate: float = 0.0,
+        use_checkpoint: bool = False,
+        post_norm: bool = False,
+        **kwargs,
+    ):
+        super().__init__()
+        self.ssm_branch = ssm_ratio > 0
+        self.mlp_branch = mlp_ratio > 0
+        self.use_checkpoint = use_checkpoint
+        self.post_norm = post_norm
+
+        if self.ssm_branch:
+            self.norm = VMambaLayerNorm2d(hidden_dim)
+            self.op = SS2D(
+                d_model=hidden_dim, 
+                d_state=ssm_d_state, 
+                ssm_ratio=ssm_ratio,
+                dt_rank=ssm_dt_rank,
+                act_layer=ssm_act_layer,
+                d_conv=ssm_conv,
+                conv_bias=ssm_conv_bias,
+                dropout=ssm_drop_rate,
+            )
+        
+        self.drop_path = DropPath(drop_path)
+        
+        if self.mlp_branch:
+            self.norm2 = VMambaLayerNorm2d(hidden_dim)
+            mlp_hidden_dim = int(hidden_dim * mlp_ratio)
+            self.mlp = VMambaMlp(in_features=hidden_dim, hidden_features=mlp_hidden_dim, act_layer=mlp_act_layer, drop=mlp_drop_rate)
+
+    def _forward(self, input: torch.Tensor):
+        x = input
+        if self.ssm_branch:
+            if self.post_norm:
+                x = x + self.drop_path(self.norm(self.op(x)))
+            else:
+                x = x + self.drop_path(self.op(self.norm(x)))
+        if self.mlp_branch:
+            if self.post_norm:
+                x = x + self.drop_path(self.norm2(self.mlp(x))) 
+            else:
+                x = x + self.drop_path(self.mlp(self.norm2(x)))
+        return x
+
+    def forward(self, input: torch.Tensor):
+        if self.use_checkpoint:
+            return checkpoint.checkpoint(self._forward, input)
+        else:
+            return self._forward(input)
+
+class VMambaLayer(nn.Module):
+
+    def __init__(
+        self,
+        input_dim,
+        depth,
+        drop_path=0.0,
+        norm_layer=VMambaLayerNorm2d,
+        downsample=nn.Identity(),
+        use_checkpoint=False,
+        **kwargs,
+    ):
+        super().__init__()
+        self.input_dim = input_dim
+        self.use_checkpoint = use_checkpoint
+
+        self.blocks = nn.ModuleList()
+        for i in range(depth):
+            self.blocks.append(
+                VSSBlock(hidden_dim=input_dim,
+                    drop_path=drop_path[i] if isinstance(drop_path, list) else drop_path,
+                    norm_layer=norm_layer,use_checkpoint=use_checkpoint,**kwargs,
+                )
+            )
+        
+        self.downsample = downsample
+
+    def forward(self, x):
+        for block in self.blocks:
+            x = block(x)
+
+        x = self.downsample(x)
+        return x
+
+class VMambaPreTrainedModel(PreTrainedModel):
+    """
+    An abstract class to handle weights initialization and
+    a simple interface for downloading and loading pretrained models.
+    """
+
+    config_class = VMambaConfig
+    base_model_prefix = "vmamba"
+    supports_gradient_checkpointing = False
+
+    def _init_weights(self, module: Union[nn.Linear, nn.Conv2d, nn.LayerNorm]) -> None:
+        """Initialize the weights"""
+        if isinstance(module, nn.Linear):
+            trunc_normal_(module.weight, std=0.02)
+            if isinstance(module, nn.Linear) and module.bias is not None:
+                nn.init.constant_(module.bias, 0)
+        elif isinstance(module, nn.LayerNorm):
+            nn.init.constant_(module.bias, 0)
+            nn.init.constant_(module.weight, 1.0)
+
+
+class VMambaModel(VMambaPreTrainedModel):
+    def __init__(self, config):
+        super().__init__(config)
+        self.config = config
+
+        dims = config.dims
+        if isinstance(dims, int):
+            dims = [int(dims * 2**i_layer) for i_layer in range(self.num_layers)]
+
+        self.dims = dims
+        self.patch_embeddings = VMambaPatchEmbeddings(patch_size=config.patch_size,
+                                                     embed_dim=dims[0])
+        
+        self.num_layers = len(config.depths)
+        dpr = [x.item() for x in torch.linspace(0, config.drop_path_rate, sum(config.depths))]
+        self.num_features = dims[-1]
+
+        self.layers = nn.ModuleList()
+        for i in range(self.num_layers):
+            layer = VMambaLayer(
+                input_dim=self.dims[i],
+                depth=config.depths[i],
+                drop_path=dpr[sum(config.depths[:i]):sum(config.depths[:i+1])],
+                downsample=VMambaDowsample(self.dims[i], self.dims[i+1]) if i < self.num_layers - 1 else nn.Identity(),
+                use_checkpoint=config.use_checkpoint,
+            )
+            self.layers.append(layer)
+        
+        self.norm = VMambaLayerNorm2d(self.num_features)
+        self.avgpool = nn.AdaptiveAvgPool2d(1)
+
+    def get_input_embeddings(self) -> VMambaPatchEmbeddings:
+        return self.patch_embeddings
+    
+    def forward(self, input_values: torch.Tensor):
+        x = self.patch_embeddings(input_values)
+        for layer in self.layers:
+            x = layer(x)
+        x = self.norm(x)
+        x = self.avgpool(x).flatten(1)
+        return x
+
+
+class VMambaForImageClassification(VMambaPreTrainedModel):
+    def __init__(self, config):
+        super().__init__(config)
+
+        self.num_classes = config.num_classes
+        self.vmamba = VMambaModel(config)
+        self.head = nn.Linear(self.vmamba.num_features, self.num_classes) if self.num_classes > 0 else nn.Identity()
+
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def forward(
+        self,
+        pixel_values: Optional[torch.Tensor] = None,
+        labels: Optional[torch.Tensor] = None,
+        return_dict: Optional[bool] = None,
+    ):
+
+        outputs = self.vmamba(
+            pixel_values,
+        )
+
+        logits = self.head(outputs)
+
+        loss = None
+        if labels is not None:
+            labels = labels.to(logits.device)
+            if self.config.loss_type == "ce":
+                loss_fct = CrossEntropyLoss()
+                loss = loss_fct(logits.view(-1, self.num_labels), labels.view(-1))
+            elif self.config.problem_type == "bce":
+                loss_fct = BCEWithLogitsLoss()
+                loss = loss_fct(logits, labels)
+
+        if return_dict:
+            output = (logits,) + (outputs,)
+            return ((loss,) + output) if loss is not None else output
+
+        return ImageClassifierOutput(
+            loss=loss,
+            logits=logits,
+            hidden_states=outputs,
+        )
+
+__all__ = [
+    "VMambaModel",
+    "VMambaPreTrainedModel",
+    "VMambaForImageClassification",
+]