Exploiting Local KV Cache Asymmetry for Long-Context LLMs (arxiv.org)
2 points by PaulHoule an hour ago | 0 comments
612 points by PaulHoule an hour ago | 0 comments
611 points by hpenedones an hour ago | 2 comments
624 points by Bluestein an hour ago | 0 comments
631 points by Topfi an hour ago | 0 comments
642 points by lukastyrychtr an hour ago | 0 comments
651 points by Dowwie an hour ago | 0 comments
662 points by mikece an hour ago | 0 comments
671 points by beejiu an hour ago | 0 comments
681 points by wip an hour ago | 0 comments
6928 points by lukastyrychtr an hour ago | 7 comments
703 points by Garbage an hour ago | 1 comment
711 points by roperzh an hour ago | 0 comments
721 points by arberavdullahu an hour ago | 0 comments
731 points by mooreds an hour ago | 0 comments
742 points by mooreds an hour ago | 0 comments
751 points by sokoloff an hour ago | 0 comments
762 points by brookejoseph an hour ago | 1 comment
771 points by greekanalyst an hour ago | 0 comments
781 points by gregorymichael an hour ago | 0 comments
791 points by digitalions an hour ago | 2 comments
801 points by webcamerapro an hour ago | 0 comments
811 points by Anon84 an hour ago | 0 comments
823 points by gmays an hour ago | 0 comments
8310 points by darkwater an hour ago | 1 comment
842 points by simonebrunozzi 2 hours ago | 0 comments
851 points by Brajeshwar 2 hours ago | 0 comments
863 points by Brajeshwar 2 hours ago | 0 comments
875 points by quintonwall 2 hours ago | 1 comment
8870 points by fanf2 2 hours ago | 7 comments
891 points by 9woc 2 hours ago | 0 comments
90